Nov 03 12:48:43 devstack cinder-volume[75327]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 12:48:43 devstack cinder-volume[75327]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 12:48:43 devstack cinder-volume[75327]: we strongly recommend against using it for new projects. Nov 03 12:48:43 devstack cinder-volume[75327]: If you are already using Eventlet, we recommend migrating to a different Nov 03 12:48:43 devstack cinder-volume[75327]: framework. For more detail see Nov 03 12:48:43 devstack cinder-volume[75327]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 12:48:43 devstack cinder-volume[75327]: import eventlet # noqa Nov 03 12:48:45 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:48:45 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:48:45 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:48:46 devstack cinder-volume[75327]: INFO dbcounter [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Registered counter for database cinder Nov 03 12:48:47 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:48:47 devstack cinder-volume[75327]: DEBUG dbcounter [-] [75327] Writer thread running {{(pid=75327) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:48:47 devstack cinder-volume[75327]: INFO cinder.rpc [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 12:48:47 devstack cinder-volume[75327]: INFO cinder.rpc [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 12:48:47 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:48:47 devstack cinder-volume[75327]: INFO cinder.volume.manager [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Determined volume DB was empty at startup. Nov 03 12:48:47 devstack cinder-volume[75327]: DEBUG cinder.volume.manager [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75327) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 12:48:47 devstack cinder-volume[75327]: INFO cinder.volume.manager [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 12:48:47 devstack cinder-volume[75327]: WARNING stevedore.named [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 12:48:47 devstack cinder-volume[75327]: WARNING castellan.key_manager [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:48:47 devstack cinder-volume[75327]: WARNING cinder.keymgr.conf_key_mgr [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:48:47 devstack cinder-volume[75327]: DEBUG cinder.volume.drivers.lvm [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75327) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 12:48:47 devstack cinder-volume[75327]: DEBUG oslo_concurrency.processutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75327) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:47 devstack cinder-volume[75327]: DEBUG oslo_concurrency.processutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] CMD "cinder-rtstool verify" returned: 0 in 0.414s {{(pid=75327) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:48:48 devstack cinder-volume[75327]: INFO cinder.rpc [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 12:48:48 devstack cinder-volume[75327]: INFO cinder.rpc [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 12:48:48 devstack cinder-volume[75327]: WARNING stevedore.named [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 12:48:48 devstack cinder-volume[75327]: WARNING castellan.key_manager [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:48:48 devstack cinder-volume[75327]: INFO cinder.volume.manager [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:48:48 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Starting 1 workers Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Started child 75478 {{(pid=75327) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Full set of CONF: {{(pid=75327) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] ******************************************************************************** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Configuration options gathered from: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] ================================================================================ {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] allow_availability_zone_fallback = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] allow_compression_on_image_upload = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] allowed_direct_url_schemes = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] api_rate_limit = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] auth_strategy = keystone {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] az_cache_duration = 3600 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_availability_zone = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_host = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_stats_polling_interval = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backup_api_class = cinder.backup.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backup_name_template = backup-%s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backup_use_same_host = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75478]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backup_use_temp_snapshot = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] chap_password = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] chap_username = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_internal_tenant_project_id = 2a122f5d1a3d460fbe9ed41047d4a401 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_internal_tenant_user_id = 72bfbc8fb8634c529031b71730ec2353 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cloned_volume_same_az = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cluster = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] compression_format = gzip {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] compute_api_class = cinder.compute.nova.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] config_dir = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] config_source = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] control_exchange = openstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] debug = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] default_availability_zone = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] default_group_type = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] default_volume_type = lvmdriver-1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] disk_geometry = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] driver_client_cert = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] driver_client_cert_key = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] driver_data_namespace = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] driver_ssl_cert_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] driver_ssl_cert_verify = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] driver_use_ssl = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] enable_force_upload = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] enable_new_services = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] enable_unsupported_driver = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] enforce_multipath_for_image_xfer = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] filter_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_api_insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_api_servers = ['http://192.168.122.166/image'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_api_ssl_compression = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_ca_certificates_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_catalog_info = image:glance:publicURL {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_num_retries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance_request_timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] goodness_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] graceful_shutdown_timeout = 5 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] group_api_class = cinder.group.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] host = devstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_compress_on_upload = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_conversion_address_space_limit = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_conversion_cpu_limit = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_conversion_disable = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_introspection_address_space_limit = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_introspection_cpu_limit = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_upload_use_cinder_backend = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_upload_use_internal_tenant = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_volume_cache_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_volume_cache_max_count = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] image_volume_cache_max_size_gb = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] init_host_max_objects_retrieval = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] instance_format = [instance: %(uuid)s] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] iscsi_target_flags = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] iscsi_write_cache = on {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] iser_helper = tgtadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] iser_ip_address = 192.168.122.166 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] iser_port = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_color = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_config_append = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_dir = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_options = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_rotate_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_rotate_interval_type = days {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] log_rotation_type = none {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] max_age = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] max_logfile_count = 30 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] max_logfile_size_mb = 200 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] max_over_subscription_ratio = 20.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] message_reap_interval = 86400 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] message_ttl = 2592000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] migration_create_volume_timeout_secs = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] monkey_patch = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] monkey_patch_modules = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] my_ip = 192.168.122.166 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] no_snapshot_gb_quota = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] num_iser_scan_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] num_shell_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] num_volume_device_scan_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] nvmeof_conn_info_version = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] nvmet_ns_id = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] nvmet_port_id = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] osapi_max_limit = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] osapi_volume_ext_list = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] osapi_volume_listen_port = 8776 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] osapi_volume_use_ssl = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] osapi_volume_workers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] per_volume_size_limit = -1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] periodic_fuzzy_delay = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] periodic_interval = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] public_endpoint = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] publish_errors = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] quota_backup_gigabytes = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] quota_backups = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] quota_gigabytes = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] quota_groups = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] quota_snapshots = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] quota_volumes = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] rate_limit_burst = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] rate_limit_except_level = CRITICAL {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] rate_limit_interval = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] reinit_driver_count = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] replication_device = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] report_discard_supported = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] report_interval = 120 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] reservation_clean_interval = 86400 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] reservation_expire = 86400 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] reserved_image_namespaces = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] reserved_percentage = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] rpc_response_timeout = 120 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] run_external_periodic_tasks = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] scst_target_driver = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] scst_target_iqn_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_down_time = 720 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] shell_completion = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] snapshot_name_template = snapshot-%s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] snapshot_same_host = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] split_loggers = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] state_path = /opt/stack/data/cinder {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] storage_availability_zone = nova {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] storage_protocol = iSCSI {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] syslog_log_facility = LOG_USER {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] target_helper = lioadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] target_ip_address = 192.168.122.166 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] target_port = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] target_protocol = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] target_secondary_ip_addresses = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] trace_flags = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] transport_url = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] until_refresh = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] use_chap_auth = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] use_default_quota_class = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] use_journal = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] use_json = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] use_multipath_for_image_xfer = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] use_stderr = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] use_syslog = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] verify_glance_signatures = enabled {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_api_class = cinder.volume.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_backend_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_clear = zero {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_clear_ionice = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_clear_size = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_copy_bps_limit = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_dd_blocksize = 1M {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_name_template = volume-%s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_service_inithost_offload = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volume_usage_audit_period = month {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] zoning_mode = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_concurrency.disable_process_locking = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.auth_section = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.auth_type = password {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.auth_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.cache = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.include_service_catalog = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.interface = public {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_password = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcache_username = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.region_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.service_type = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.166/identity {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.backend = dogpile.cache.null {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.backend_argument = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.backend_expiration_time = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.config_prefix = cache.oslo {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.debug_cache_backend = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.enable_retry_client = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.enable_socket_keepalive = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.expiration_time = 600 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.hashclient_retry_attempts = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.memcache_dead_retry = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.memcache_pool_maxsize = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.memcache_sasl_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.password = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.proxies = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.redis_db = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.redis_server = localhost:6379 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.retry_attempts = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.retry_delay = 0.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.socket_keepalive_count = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.socket_keepalive_idle = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.socket_keepalive_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.socket_timeout = 1.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.tls_allowed_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.tls_cafile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.tls_certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.tls_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.tls_keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cache.username = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] coordination.backend_url = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.asyncio_connection = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.asyncio_slave_connection = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.backend = sqlalchemy {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.connection = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.connection_debug = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.connection_parameters = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.connection_recycle_time = 3600 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.connection_trace = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.db_inc_retry_interval = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.db_max_retries = 20 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.db_max_retry_interval = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.db_retry_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.max_overflow = 50 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.max_pool_size = 5 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.max_retries = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.mysql_wsrep_sync_wait = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.pool_timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.retry_interval = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.slave_connection = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.sqlite_synchronous = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.synchronous_reader = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] database.use_db_reconnect = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_tracing.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.connection_string = messaging:// {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.es_doc_type = notification {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.es_scroll_size = 10000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.es_scroll_time = 2m {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.filter_error_trace = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.hmac_keys = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.sentinel_service_name = mymaster {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.socket_timeout = 0.1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.trace_requests = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler.trace_sqlalchemy = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler_jaeger.process_tags = {} {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler_jaeger.service_name_prefix = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] profiler_otlp.service_name_prefix = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.enforce_new_defaults = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.policy_default_rule = default {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.policy_file = policy.yaml {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] privsep_osbrick.group = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] privsep_osbrick.helper_command = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] privsep_osbrick.user = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_sys_admin.group = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_sys_admin.helper_command = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] cinder_sys_admin.user = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.auth_section = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.auth_type = password {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.cafile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.collect_timing = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.send_service_user_token = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.split_loggers = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.tls_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] service_user.tls_min_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.auth_section = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.auth_type = password {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.collect_timing = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.region_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.split_loggers = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.tls_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] glance.tls_min_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.backend_availability_zone = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.chap_password = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.chap_username = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.disk_geometry = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.driver_client_cert = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.driver_client_cert_key = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.driver_data_namespace = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.driver_use_ssl = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.extra_capabilities = {} {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.filter_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.goodness_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.iscsi_target_flags = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.iscsi_write_cache = on {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.iser_helper = tgtadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.iser_ip_address = 192.168.122.166 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.iser_port = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.lvm_share_target = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.lvm_type = auto {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.num_shell_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.replication_device = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.report_discard_supported = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.reserved_percentage = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.target_helper = tgtadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.target_ip_address = 192.168.122.166 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack sudo[75489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.target_port = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.target_protocol = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack sudo[75489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.trace_flags = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.unique_fqdn_network = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.use_chap_auth = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_backend_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_clear = zero {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_clear_ionice = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_clear_size = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_reports.file_event_handler = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_reports.log_dir = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.backend_host = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.chap_password = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.chap_username = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.disk_geometry = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.driver_client_cert = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.extra_capabilities = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.filter_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.goodness_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.iser_helper = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.iser_ip_address = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.iser_port = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.lvm_share_target = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.lvm_type = auto {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.num_shell_tries = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.replication_device = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.report_discard_supported = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.reserved_percentage = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.scst_target_driver = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.storage_protocol = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.target_helper = lioadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.target_ip_address = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.target_port = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.trace_flags = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.use_chap_auth = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_clear = zero {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_clear_size = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] lvmdriver-1.volumes_dir = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.ssl = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_notifications.driver = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_notifications.retry = -1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] key_manager.fixed_key = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.barbican_api_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.barbican_endpoint = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.barbican_endpoint_type = public {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.barbican_region_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.cafile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.collect_timing = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.number_of_retries = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.retry_delay = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.send_service_user_token = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.split_loggers = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.tls_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.tls_min_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.verify_ssl = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican.verify_ssl_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.auth_section = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.auth_type = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.cafile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.collect_timing = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.split_loggers = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.tls_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] barbican_service_user.tls_min_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.approle_role_id = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.approle_secret_id = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.auth_method = approle {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.auth_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.kv_mountpoint = secret {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.kv_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.kv_version = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.namespace = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.root_token_id = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.ssl_ca_crt_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.timeout = 60.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.token_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.token_role = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.use_ssl = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:48:48 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] ******************************************************************************** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 12:48:48 devstack sudo[75489]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:48 devstack sudo[75612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:48 devstack sudo[75612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:49 devstack sudo[75612]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:48:49 devstack cinder-volume[75478]: INFO cinder.brick.local_dev.lvm [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:49 devstack sudo[75707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:48:49 devstack sudo[75707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:49 devstack sudo[75707]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG cinder.brick.local_dev.lvm [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75478) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:49 devstack sudo[75787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:49 devstack sudo[75787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:49 devstack sudo[75787]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:49 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:49 devstack sudo[75971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:49 devstack sudo[75971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:50 devstack sudo[75971]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.326s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:50 devstack sudo[76090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 12:48:50 devstack sudo[76090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:50 devstack sudo[76090]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.261s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:50 devstack sudo[76093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:48:50 devstack sudo[76093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:50 devstack sudo[76093]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.352s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:50 devstack sudo[76177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:48:50 devstack sudo[76177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:51 devstack sudo[76177]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:51 devstack sudo[76180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:48:51 devstack sudo[76180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:51 devstack sudo[76180]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:51 devstack sudo[76246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:51 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:51 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:51 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:51 devstack sudo[76273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:51 devstack sudo[76273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:52 devstack sudo[76273]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:52 devstack cinder-volume[75478]: INFO cinder.volume.drivers.lvm [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:52 devstack sudo[76283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:52 devstack sudo[76283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:52 devstack sudo[76283]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:52 devstack sudo[76287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:48:52 devstack sudo[76287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:52 devstack sudo[76287]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:52 devstack sudo[76290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:48:52 devstack sudo[76290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:52 devstack sudo[76290]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:52 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:52 devstack sudo[76293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:52 devstack sudo[76293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:53 devstack sudo[76293]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:53 devstack sudo[76296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:48:53 devstack sudo[76296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:53 devstack sudo[76296]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:53 devstack cinder-volume[75478]: INFO cinder.volume.driver [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG cinder.volume.driver [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75478) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG oslo_db.sqlalchemy.engines [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writer thread running {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG cinder.db.api [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Building query based on filter {{(pid=75478) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG cinder.image.image_utils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75478) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 12:48:53 devstack cinder-volume[75478]: INFO cinder.keymgr.migration [None req-1f15657f-d84f-49fe-a3d2-674d8fb2520f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:53 devstack sudo[76299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:48:53 devstack sudo[76299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:53 devstack sudo[76299]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:53 devstack sudo[76306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:48:53 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:54 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:54 devstack sudo[76309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:54 devstack sudo[76309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:54 devstack sudo[76309]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:54 devstack sudo[76312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:48:54 devstack sudo[76312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:54 devstack sudo[76312]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:48:54 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Driver initialization completed successfully. Nov 03 12:48:54 devstack cinder-volume[75478]: INFO cinder.manager [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Initiating service 2 cleanup Nov 03 12:48:54 devstack cinder-volume[75478]: INFO cinder.manager [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Service 2 cleanup completed. Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG cinder.service [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Creating RPC server for service cinder-volume {{(pid=75478) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG cinder.service [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75478) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 12:48:54 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:48:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:54 devstack sudo[76315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:48:54 devstack sudo[76315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:55 devstack sudo[76315]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:55 devstack sudo[76320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:48:55 devstack sudo[76320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:55 devstack sudo[76320]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:55 devstack sudo[76326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:48:55 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:55 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:48:55 devstack sudo[76329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:48:55 devstack sudo[76329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:48:55 devstack sudo[76329]: pam_unix(sudo:session): session closed for user root Nov 03 12:48:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:48:55 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-8a3b378f-f9a8-4642-a8f3-eb7721ebfe21 None None] Driver post RPC initialization completed successfully. Nov 03 12:48:58 devstack cinder-volume[75327]: DEBUG dbcounter [-] [75327] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75327) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:49:05 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:49:05 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:49:37 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running periodic task VolumeManager._thread_info {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:49:37 devstack cinder-volume[75478]: DEBUG cinder.volume.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] thread count: 6 {{(pid=75478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:49:37 devstack cinder-volume[75478]: DEBUG cinder.volume.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] thread info: [<_MainThread(MainThread, started 139497382903936)>, , , , , ] {{(pid=75478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:50:37 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:50:37 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:50:37 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:50:37 devstack sudo[81442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:50:37 devstack sudo[81442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:50:38 devstack sudo[81442]: pam_unix(sudo:session): session closed for user root Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:50:38 devstack sudo[81445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:50:38 devstack sudo[81445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:50:38 devstack sudo[81445]: pam_unix(sudo:session): session closed for user root Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:50:38 devstack sudo[81448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:50:38 devstack sudo[81448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:50:38 devstack sudo[81448]: pam_unix(sudo:session): session closed for user root Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:50:38 devstack sudo[81451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:50:38 devstack sudo[81451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:50:38 devstack sudo[81451]: pam_unix(sudo:session): session closed for user root Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running periodic task VolumeManager._thread_info {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG cinder.volume.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] thread count: 6 {{(pid=75478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:50:38 devstack cinder-volume[75478]: DEBUG cinder.volume.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] thread info: [<_MainThread(MainThread, started 139497382903936)>, , , , , ] {{(pid=75478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:51:05 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:51:37 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:51:37 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:51:37 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:51:37 devstack sudo[83312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:51:37 devstack sudo[83312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:51:38 devstack sudo[83312]: pam_unix(sudo:session): session closed for user root Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:51:38 devstack sudo[83315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:51:38 devstack sudo[83315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:51:38 devstack sudo[83315]: pam_unix(sudo:session): session closed for user root Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:51:38 devstack sudo[83327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:51:38 devstack sudo[83327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:51:38 devstack sudo[83327]: pam_unix(sudo:session): session closed for user root Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:51:38 devstack sudo[83330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:51:38 devstack sudo[83330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:51:38 devstack sudo[83330]: pam_unix(sudo:session): session closed for user root Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:51:38 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:52:37 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:52:37 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 12:52:37 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:52:37 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 12:52:37 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:52:38 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:52:38 devstack sudo[84734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:52:38 devstack sudo[84734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:52:38 devstack sudo[84734]: pam_unix(sudo:session): session closed for user root Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:52:38 devstack sudo[84737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 12:52:38 devstack sudo[84737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:52:38 devstack sudo[84737]: pam_unix(sudo:session): session closed for user root Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:52:38 devstack sudo[84751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 12:52:38 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:52:38 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] Running periodic task VolumeManager._thread_info {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG cinder.volume.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] thread count: 6 {{(pid=75478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:52:38 devstack cinder-volume[75478]: DEBUG cinder.volume.manager [None req-46b15450-fe9d-42ec-a0fe-58f0c17b0f7b None None] thread info: [<_MainThread(MainThread, started 139497382903936)>, , , , , ] {{(pid=75478) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:53:05 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:53:05 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:53:13 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Caught SIGTERM, stopping children Nov 03 12:53:13 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Acquiring lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:53:13 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Acquired lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:53:13 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Releasing lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:53:13 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Stop services. {{(pid=75327) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 12:53:13 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Killing children. {{(pid=75327) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 12:53:13 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Waiting on 1 children to exit Nov 03 12:53:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Acquiring lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:53:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Acquired lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:53:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Releasing lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:53:14 devstack cinder-volume[75478]: WARNING amqp [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:53:14 devstack cinder-volume[75478]: WARNING amqp [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:53:14 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-5855dedc-1963-4de9-816a-2e377aaaa55f None None] Child 75478 exited with status 0 Nov 03 12:53:15 devstack cinder-volume[85502]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 12:53:15 devstack cinder-volume[85502]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 12:53:15 devstack cinder-volume[85502]: we strongly recommend against using it for new projects. Nov 03 12:53:15 devstack cinder-volume[85502]: If you are already using Eventlet, we recommend migrating to a different Nov 03 12:53:15 devstack cinder-volume[85502]: framework. For more detail see Nov 03 12:53:15 devstack cinder-volume[85502]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 12:53:15 devstack cinder-volume[85502]: import eventlet # noqa Nov 03 12:53:17 devstack cinder-volume[85502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:53:17 devstack cinder-volume[85502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:53:17 devstack cinder-volume[85502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:53:17 devstack cinder-volume[85502]: INFO dbcounter [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Registered counter for database cinder Nov 03 12:53:17 devstack cinder-volume[85502]: DEBUG oslo_db.sqlalchemy.engines [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG dbcounter [-] [85502] Writer thread running {{(pid=85502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:53:18 devstack cinder-volume[85502]: INFO cinder.rpc [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 12:53:18 devstack cinder-volume[85502]: INFO cinder.rpc [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_db.sqlalchemy.engines [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:18 devstack cinder-volume[85502]: INFO cinder.volume.manager [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Determined volume DB was empty at startup. Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG cinder.volume.manager [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85502) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 12:53:18 devstack cinder-volume[85502]: INFO cinder.volume.manager [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 12:53:18 devstack cinder-volume[85502]: WARNING stevedore.named [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 12:53:18 devstack cinder-volume[85502]: WARNING castellan.key_manager [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:53:18 devstack cinder-volume[85502]: WARNING cinder.keymgr.conf_key_mgr [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:53:18 devstack cinder-volume[85502]: INFO cinder.volume.manager [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_db.sqlalchemy.engines [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:18 devstack cinder-volume[85502]: INFO oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Starting 1 workers Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Started child 85717 {{(pid=85502) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Full set of CONF: {{(pid=85502) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] ******************************************************************************** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Configuration options gathered from: {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] ================================================================================ {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] allow_availability_zone_fallback = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85717]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] allow_compression_on_image_upload = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] allowed_direct_url_schemes = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] api_rate_limit = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] auth_strategy = keystone {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_availability_zone = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_host = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_stats_polling_interval = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backup_api_class = cinder.backup.api.API {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backup_name_template = backup-%s {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backup_use_same_host = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backup_use_temp_snapshot = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] chap_password = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] chap_username = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_internal_tenant_project_id = 2a122f5d1a3d460fbe9ed41047d4a401 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_internal_tenant_user_id = 72bfbc8fb8634c529031b71730ec2353 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cluster = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] compression_format = gzip {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] compute_api_class = cinder.compute.nova.API {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] config_dir = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] config_source = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] control_exchange = openstack {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] debug = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] default_availability_zone = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] default_group_type = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] default_volume_type = QuobyteHD {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] disk_geometry = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] driver_client_cert = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] driver_client_cert_key = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] driver_data_namespace = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] driver_ssl_cert_path = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] driver_ssl_cert_verify = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] driver_use_ssl = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] enable_new_services = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] enable_unsupported_driver = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] enabled_backends = ['QuobyteHD'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] enforce_multipath_for_image_xfer = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] filter_function = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_api_insecure = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_api_servers = ['http://192.168.122.166/image'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_api_ssl_compression = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_ca_certificates_file = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_catalog_info = image:glance:publicURL {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_num_retries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance_request_timeout = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] goodness_function = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] graceful_shutdown_timeout = 5 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] group_api_class = cinder.group.api.API {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] host = devstack {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_compress_on_upload = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_conversion_address_space_limit = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_conversion_cpu_limit = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_conversion_disable = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_introspection_address_space_limit = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_introspection_cpu_limit = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_upload_use_cinder_backend = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_upload_use_internal_tenant = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_volume_cache_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_volume_cache_max_count = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] image_volume_cache_max_size_gb = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] init_host_max_objects_retrieval = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] instance_format = [instance: %(uuid)s] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] iscsi_target_flags = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] iscsi_write_cache = on {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] iser_helper = tgtadm {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] iser_ip_address = 192.168.122.166 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] iser_port = 3260 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_color = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_config_append = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_dir = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_file = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_options = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_rotate_interval = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_rotate_interval_type = days {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] log_rotation_type = none {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] max_age = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] max_logfile_count = 30 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] max_logfile_size_mb = 200 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] max_over_subscription_ratio = 20.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] message_reap_interval = 86400 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.remotefs [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85717) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] message_ttl = 2592000 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] migration_create_volume_timeout_secs = 300 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] monkey_patch = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] monkey_patch_modules = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] my_ip = 192.168.122.166 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] no_snapshot_gb_quota = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] num_iser_scan_tries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] num_shell_tries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] num_volume_device_scan_tries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] nvmeof_conn_info_version = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] nvmet_ns_id = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] nvmet_port_id = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] osapi_max_limit = 1000 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] osapi_volume_ext_list = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] osapi_volume_listen_port = 8776 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] osapi_volume_use_ssl = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] osapi_volume_workers = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] per_volume_size_limit = -1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] periodic_fuzzy_delay = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] periodic_interval = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] public_endpoint = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] publish_errors = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] quota_backup_gigabytes = 1000 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] quota_backups = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] quota_gigabytes = 1000 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] quota_groups = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] quota_snapshots = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] quota_volumes = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] rate_limit_burst = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] rate_limit_except_level = CRITICAL {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] rate_limit_interval = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] reinit_driver_count = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] replication_device = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] report_discard_supported = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] report_interval = 120 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] reservation_clean_interval = 86400 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] reservation_expire = 86400 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] reserved_image_namespaces = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] reserved_percentage = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] rpc_response_timeout = 120 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] run_external_periodic_tasks = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] scst_target_driver = iscsi {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] scst_target_iqn_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_down_time = 720 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] shell_completion = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] snapshot_name_template = snapshot-%s {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] split_loggers = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] state_path = /opt/stack/data/cinder {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] storage_availability_zone = nova {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] storage_protocol = iSCSI {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] syslog_log_facility = LOG_USER {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] target_helper = lioadm {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] target_ip_address = 192.168.122.166 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] target_port = 3260 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] target_protocol = iscsi {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] target_secondary_ip_addresses = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] trace_flags = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] transport_url = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] until_refresh = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] use_chap_auth = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] use_default_quota_class = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] use_journal = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] use_json = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] use_multipath_for_image_xfer = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] use_stderr = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] use_syslog = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] verify_glance_signatures = enabled {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_api_class = cinder.volume.api.API {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_backend_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_clear = zero {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_clear_ionice = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_clear_size = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_copy_bps_limit = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_dd_blocksize = 1M {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_name_template = volume-%s {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_service_inithost_offload = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volume_usage_audit_period = month {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] zoning_mode = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_concurrency.disable_process_locking = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.auth_section = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.auth_type = password {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.auth_version = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.cache = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.include_service_catalog = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.insecure = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.interface = public {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_password = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcache_username = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.region_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.service_type = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.166/identity {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.backend = dogpile.cache.null {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85717) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.backend_argument = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85717]: WARNING cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 12:53:18 devstack cinder-volume[85717]: WARNING cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.backend_expiration_time = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.config_prefix = cache.oslo {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.debug_cache_backend = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.enable_retry_client = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Running cmd (subprocess): mount.quobyte {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.enable_socket_keepalive = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.expiration_time = 600 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.hashclient_retry_attempts = 2 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.memcache_dead_retry = 300 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.memcache_pool_maxsize = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.memcache_sasl_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.password = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.proxies = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.redis_db = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.redis_server = localhost:6379 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.retry_attempts = 2 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.retry_delay = 0.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.socket_keepalive_count = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.socket_keepalive_idle = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.socket_keepalive_interval = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.socket_timeout = 1.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.tls_allowed_ciphers = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.tls_cafile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.tls_certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.tls_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.tls_keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cache.username = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] coordination.backend_url = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.asyncio_connection = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.asyncio_slave_connection = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.backend = sqlalchemy {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.connection = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.connection_debug = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.connection_parameters = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.connection_recycle_time = 3600 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.connection_trace = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.db_inc_retry_interval = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.db_max_retries = 20 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.db_max_retry_interval = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.db_retry_interval = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.max_overflow = 50 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.max_pool_size = 5 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.max_retries = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.mysql_wsrep_sync_wait = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.pool_timeout = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.retry_interval = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.slave_connection = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.sqlite_synchronous = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.synchronous_reader = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] database.use_db_reconnect = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_tracing.insecure = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.connection_string = messaging:// {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.es_doc_type = notification {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.es_scroll_size = 10000 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.es_scroll_time = 2m {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.filter_error_trace = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.hmac_keys = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.sentinel_service_name = mymaster {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.socket_timeout = 0.1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.trace_requests = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler.trace_sqlalchemy = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler_jaeger.process_tags = {} {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler_jaeger.service_name_prefix = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] profiler_otlp.service_name_prefix = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.enforce_new_defaults = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.policy_default_rule = default {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.policy_file = policy.yaml {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] privsep_osbrick.group = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] privsep_osbrick.helper_command = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] privsep_osbrick.user = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_sys_admin.group = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_sys_admin.helper_command = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] cinder_sys_admin.user = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.auth_section = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.auth_type = password {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.cafile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.collect_timing = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.insecure = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.send_service_user_token = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.split_loggers = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.timeout = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.tls_ciphers = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] service_user.tls_min_version = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.auth_section = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.auth_type = password {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.collect_timing = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.insecure = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.region_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.split_loggers = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.timeout = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.tls_ciphers = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] glance.tls_min_version = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.backend_availability_zone = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.chap_password = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.chap_username = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.disk_geometry = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.driver_client_cert = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.driver_client_cert_key = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.driver_data_namespace = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.driver_use_ssl = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.extra_capabilities = {} {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.filter_function = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.goodness_function = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.iscsi_target_flags = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.iscsi_write_cache = on {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.iser_helper = tgtadm {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.iser_ip_address = 192.168.122.166 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.iser_port = 3260 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_host = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_login = admin {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_mount_options = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_password = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_private_key = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_share_path = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.num_shell_tries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.quobyte_volume_url = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.replication_device = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.report_discard_supported = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.reserved_percentage = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.target_helper = tgtadm {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.target_ip_address = 192.168.122.166 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.target_port = 3260 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.target_protocol = iscsi {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.trace_flags = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.unique_fqdn_network = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.use_chap_auth = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_backend_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_clear = zero {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_clear_ionice = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_clear_size = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_reports.file_event_handler = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_reports.log_dir = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.backend_availability_zone = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.backend_host = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.chap_password = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.chap_username = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.chiscsi_conf = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.disk_geometry = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.driver_client_cert = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=85717) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.driver_data_namespace = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.driver_use_ssl = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85717]: INFO cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 ... Nov 03 12:53:18 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 -c /etc/quobyte/client-cinder.cfg {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.extra_capabilities = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.filter_function = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.goodness_function = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.iser_helper = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.iser_ip_address = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.iser_port = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.iser_target_prefix = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_host = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_login = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_mount_options = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_password = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_private_key = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_share_path = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_ssh_port = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.num_shell_tries = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.nvmet_port_id = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.replication_device = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.report_discard_supported = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.reserved_percentage = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.scst_target_driver = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.storage_protocol = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.target_helper = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.target_ip_address = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.target_port = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 -c /etc/quobyte/client-cinder.cfg Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.target_prefix = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.target_protocol = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.trace_flags = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.use_chap_auth = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_clear = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_clear_size = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] QuobyteHD.volumes_dir = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.ssl = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_notifications.driver = [] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_notifications.retry = -1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] key_manager.fixed_key = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.barbican_api_version = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.barbican_endpoint = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.barbican_endpoint_type = public {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.barbican_region_name = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.cafile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.collect_timing = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.insecure = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.number_of_retries = 60 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.retry_delay = 1 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.send_service_user_token = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.split_loggers = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.timeout = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.tls_ciphers = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.tls_min_version = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.verify_ssl = True {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican.verify_ssl_path = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.auth_section = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.auth_type = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.cafile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.certfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.collect_timing = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.insecure = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.keyfile = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.split_loggers = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.timeout = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.tls_ciphers = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] barbican_service_user.tls_min_version = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.approle_role_id = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.approle_secret_id = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.auth_method = approle {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.auth_path = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.kv_mountpoint = secret {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.kv_path = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.kv_version = 2 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.namespace = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.root_token_id = **** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.ssl_ca_crt_file = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.timeout = 60.0 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.token_file = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.token_role = None {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.use_ssl = False {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:18 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] ******************************************************************************** {{(pid=85502) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 12:53:19 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.459s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:19 devstack cinder-volume[85717]: INFO cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 succeeded Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=85717) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.474s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:19 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:53:19 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:19 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.235s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:19 devstack cinder-volume[85717]: INFO cinder.volume.driver [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.volume.driver [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7330017089844, 'free_capacity_gb': 1773.7330017089844, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85717) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_db.sqlalchemy.engines [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG dbcounter [-] [85717] Writer thread running {{(pid=85717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.db.api [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Building query based on filter {{(pid=85717) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.image.image_utils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85717) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 12:53:19 devstack cinder-volume[85717]: INFO cinder.keymgr.migration [None req-055e6d54-78c0-4c41-80b3-7f761b3c3728 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=85717) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=85717) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:19 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:53:19 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:19 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.228s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.manager [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Notifying Schedulers of capabilities ... {{(pid=85717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:53:19 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Driver initialization completed successfully. Nov 03 12:53:19 devstack cinder-volume[85717]: INFO cinder.manager [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Initiating service 3 cleanup Nov 03 12:53:19 devstack cinder-volume[85717]: INFO cinder.manager [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Service 3 cleanup completed. Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.service [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Creating RPC server for service cinder-volume {{(pid=85717) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 12:53:19 devstack cinder-volume[85717]: DEBUG cinder.service [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85717) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 12:53:20 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 12:53:20 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:53:20 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:53:20 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=85717) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:53:20 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=85717) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:53:20 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:53:20 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:20 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:53:20 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:20 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:20 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.256s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:20 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-fc832f65-9954-49d8-9d36-ade1d0d07da5 None None] Driver post RPC initialization completed successfully. Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=85717) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=85717) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:24 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:53:24 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:24 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.243s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:24 devstack cinder-volume[85717]: DEBUG cinder.manager [None req-b7832913-6fc2-435d-98fd-1e75f2a4e685 None None] Notifying Schedulers of capabilities ... {{(pid=85717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:53:25 devstack cinder-volume[85502]: INFO oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Caught SIGTERM, stopping children Nov 03 12:53:25 devstack cinder-volume[85502]: DEBUG oslo_concurrency.lockutils [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Acquiring lock "singleton_lock" {{(pid=85502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:53:25 devstack cinder-volume[85502]: DEBUG oslo_concurrency.lockutils [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Acquired lock "singleton_lock" {{(pid=85502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:53:25 devstack cinder-volume[85502]: DEBUG oslo_concurrency.lockutils [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Releasing lock "singleton_lock" {{(pid=85502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:53:25 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Stop services. {{(pid=85502) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 12:53:25 devstack cinder-volume[85502]: DEBUG oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Killing children. {{(pid=85502) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 12:53:25 devstack cinder-volume[85502]: INFO oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Waiting on 1 children to exit Nov 03 12:53:28 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Acquiring lock "singleton_lock" {{(pid=85717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:53:28 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Acquired lock "singleton_lock" {{(pid=85717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:53:28 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Releasing lock "singleton_lock" {{(pid=85717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:53:28 devstack cinder-volume[85717]: WARNING amqp [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:53:28 devstack cinder-volume[85717]: WARNING amqp [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 12:53:28 devstack cinder-volume[85502]: INFO oslo_service.backend._eventlet.service [None req-38bcd7b4-63c5-4776-a21b-411407dff189 None None] Child 85717 exited with status 0 Nov 03 12:53:28 devstack cinder-volume[86033]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 12:53:28 devstack cinder-volume[86033]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 12:53:28 devstack cinder-volume[86033]: we strongly recommend against using it for new projects. Nov 03 12:53:28 devstack cinder-volume[86033]: If you are already using Eventlet, we recommend migrating to a different Nov 03 12:53:28 devstack cinder-volume[86033]: framework. For more detail see Nov 03 12:53:28 devstack cinder-volume[86033]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 12:53:28 devstack cinder-volume[86033]: import eventlet # noqa Nov 03 12:53:31 devstack cinder-volume[86033]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 12:53:31 devstack cinder-volume[86033]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 12:53:31 devstack cinder-volume[86033]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 12:53:32 devstack cinder-volume[86033]: INFO dbcounter [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Registered counter for database cinder Nov 03 12:53:32 devstack cinder-volume[86033]: DEBUG oslo_db.sqlalchemy.engines [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG dbcounter [-] [86033] Writer thread running {{(pid=86033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:53:33 devstack cinder-volume[86033]: INFO cinder.rpc [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 12:53:33 devstack cinder-volume[86033]: INFO cinder.rpc [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_db.sqlalchemy.engines [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:33 devstack cinder-volume[86033]: INFO cinder.volume.manager [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Determined volume DB was empty at startup. Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG cinder.volume.manager [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86033) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 12:53:33 devstack cinder-volume[86033]: WARNING stevedore.named [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 12:53:33 devstack cinder-volume[86033]: WARNING castellan.key_manager [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:53:33 devstack cinder-volume[86033]: WARNING cinder.keymgr.conf_key_mgr [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 12:53:33 devstack cinder-volume[86033]: INFO cinder.volume.manager [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_db.sqlalchemy.engines [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:33 devstack cinder-volume[86033]: INFO oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Starting 1 workers Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Started child 86369 {{(pid=86033) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Full set of CONF: {{(pid=86033) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] ******************************************************************************** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] Configuration options gathered from: {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 12:53:33 devstack cinder-volume[86369]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] ================================================================================ {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] allow_availability_zone_fallback = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] allow_compression_on_image_upload = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] allowed_direct_url_schemes = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] api_rate_limit = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] auth_strategy = keystone {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_availability_zone = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_host = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_stats_polling_interval = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backup_api_class = cinder.backup.api.API {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backup_name_template = backup-%s {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backup_use_same_host = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backup_use_temp_snapshot = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] chap_password = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] chap_username = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_internal_tenant_project_id = 2a122f5d1a3d460fbe9ed41047d4a401 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_internal_tenant_user_id = 72bfbc8fb8634c529031b71730ec2353 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cluster = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] compression_format = gzip {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] compute_api_class = cinder.compute.nova.API {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] config_dir = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] config_source = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] control_exchange = openstack {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] debug = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] default_availability_zone = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] default_group_type = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] default_volume_type = QuobyteHD {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] disk_geometry = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] driver_client_cert = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] driver_client_cert_key = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] driver_data_namespace = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] driver_ssl_cert_path = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] driver_ssl_cert_verify = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] driver_use_ssl = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] enable_new_services = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] enable_unsupported_driver = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] enabled_backends = ['QuobyteHD'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] enforce_multipath_for_image_xfer = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] filter_function = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_api_insecure = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_api_servers = ['http://192.168.122.166/image'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_api_ssl_compression = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_ca_certificates_file = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_catalog_info = image:glance:publicURL {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_num_retries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance_request_timeout = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] goodness_function = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] graceful_shutdown_timeout = 5 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] group_api_class = cinder.group.api.API {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] host = devstack {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_compress_on_upload = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_conversion_address_space_limit = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_conversion_cpu_limit = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_conversion_disable = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_introspection_address_space_limit = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_introspection_cpu_limit = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_upload_use_cinder_backend = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_upload_use_internal_tenant = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_volume_cache_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_volume_cache_max_count = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] image_volume_cache_max_size_gb = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] init_host_max_objects_retrieval = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] instance_format = [instance: %(uuid)s] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] iscsi_target_flags = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] iscsi_write_cache = on {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] iser_helper = tgtadm {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] iser_ip_address = 192.168.122.166 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] iser_port = 3260 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_color = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_config_append = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_dir = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_file = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_options = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_rotate_interval = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_rotate_interval_type = days {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] log_rotation_type = none {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86369) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] max_age = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] max_logfile_count = 30 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] max_logfile_size_mb = 200 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] max_over_subscription_ratio = 20.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] message_reap_interval = 86400 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] message_ttl = 2592000 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] migration_create_volume_timeout_secs = 300 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] monkey_patch = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] monkey_patch_modules = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] my_ip = 192.168.122.166 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] no_snapshot_gb_quota = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] num_iser_scan_tries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] num_shell_tries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] num_volume_device_scan_tries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] nvmeof_conn_info_version = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] nvmet_ns_id = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] nvmet_port_id = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] osapi_max_limit = 1000 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] osapi_volume_ext_list = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] osapi_volume_listen_port = 8776 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] osapi_volume_use_ssl = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] osapi_volume_workers = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] per_volume_size_limit = -1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] periodic_fuzzy_delay = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] periodic_interval = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] public_endpoint = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] publish_errors = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] quota_backup_gigabytes = 1000 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] quota_backups = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] quota_gigabytes = 1000 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] quota_groups = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] quota_snapshots = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] quota_volumes = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] rate_limit_burst = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] rate_limit_except_level = CRITICAL {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] rate_limit_interval = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] reinit_driver_count = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] replication_device = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] report_discard_supported = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] report_interval = 120 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] reservation_clean_interval = 86400 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] reservation_expire = 86400 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] reserved_image_namespaces = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] reserved_percentage = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] rpc_response_timeout = 120 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] run_external_periodic_tasks = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] scst_target_driver = iscsi {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] scst_target_iqn_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_down_time = 720 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] shell_completion = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] snapshot_name_template = snapshot-%s {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] split_loggers = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] state_path = /opt/stack/data/cinder {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] storage_availability_zone = nova {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] storage_protocol = iSCSI {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] syslog_log_facility = LOG_USER {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] target_helper = lioadm {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] target_ip_address = 192.168.122.166 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] target_port = 3260 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] target_protocol = iscsi {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] target_secondary_ip_addresses = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] trace_flags = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] transport_url = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] until_refresh = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] use_chap_auth = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] use_default_quota_class = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] use_journal = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] use_json = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] use_multipath_for_image_xfer = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] use_stderr = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] use_syslog = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] verify_glance_signatures = enabled {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_api_class = cinder.volume.api.API {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_backend_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_clear = zero {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_clear_ionice = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_clear_size = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_copy_bps_limit = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_dd_blocksize = 1M {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_name_template = volume-%s {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_service_inithost_offload = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volume_usage_audit_period = month {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] zoning_mode = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_concurrency.disable_process_locking = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.auth_section = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.auth_type = password {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.auth_version = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.cache = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.include_service_catalog = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.insecure = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.interface = public {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_password = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcache_username = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.region_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.service_type = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.166/identity {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.backend = dogpile.cache.null {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.backend_argument = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.backend_expiration_time = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.config_prefix = cache.oslo {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.debug_cache_backend = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.enable_retry_client = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.enable_socket_keepalive = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.expiration_time = 600 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.hashclient_retry_attempts = 2 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.memcache_dead_retry = 300 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.memcache_pool_maxsize = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.memcache_sasl_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.password = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.proxies = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.redis_db = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.redis_server = localhost:6379 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.retry_attempts = 2 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.retry_delay = 0.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.socket_keepalive_count = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.socket_keepalive_idle = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.socket_keepalive_interval = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.socket_timeout = 1.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.tls_allowed_ciphers = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.tls_cafile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.tls_certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.tls_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.tls_keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cache.username = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] coordination.backend_url = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.asyncio_connection = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.asyncio_slave_connection = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.backend = sqlalchemy {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.connection = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.connection_debug = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.connection_parameters = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.connection_recycle_time = 3600 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.connection_trace = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.db_inc_retry_interval = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.db_max_retries = 20 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.db_max_retry_interval = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.db_retry_interval = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.max_overflow = 50 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.max_pool_size = 5 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.max_retries = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.mysql_wsrep_sync_wait = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.pool_timeout = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.retry_interval = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.slave_connection = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.sqlite_synchronous = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.synchronous_reader = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] database.use_db_reconnect = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_tracing.insecure = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.connection_string = messaging:// {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.es_doc_type = notification {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.es_scroll_size = 10000 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.es_scroll_time = 2m {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.filter_error_trace = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.hmac_keys = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.sentinel_service_name = mymaster {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.socket_timeout = 0.1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.trace_requests = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler.trace_sqlalchemy = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler_jaeger.process_tags = {} {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler_jaeger.service_name_prefix = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] profiler_otlp.service_name_prefix = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.enforce_new_defaults = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.policy_default_rule = default {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.policy_file = policy.yaml {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] privsep_osbrick.group = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] privsep_osbrick.helper_command = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] privsep_osbrick.user = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_sys_admin.group = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_sys_admin.helper_command = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] cinder_sys_admin.user = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.auth_section = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.auth_type = password {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.cafile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.collect_timing = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.insecure = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.send_service_user_token = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.split_loggers = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.timeout = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.tls_ciphers = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] service_user.tls_min_version = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.auth_section = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86369) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.auth_type = password {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.collect_timing = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.insecure = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.region_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.split_loggers = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.timeout = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.tls_ciphers = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] glance.tls_min_version = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.backend_availability_zone = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.chap_password = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.chap_username = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.disk_geometry = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.driver_client_cert = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.driver_client_cert_key = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.driver_data_namespace = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.driver_use_ssl = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.extra_capabilities = {} {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.filter_function = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.goodness_function = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.iscsi_target_flags = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.iscsi_write_cache = on {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.iser_helper = tgtadm {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.iser_ip_address = 192.168.122.166 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.iser_port = 3260 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Running cmd (subprocess): mount.quobyte {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_host = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_login = admin {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_mount_options = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_password = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_private_key = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_share_path = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.num_shell_tries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.quobyte_volume_url = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.replication_device = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.report_discard_supported = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.reserved_percentage = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.target_helper = tgtadm {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.target_ip_address = 192.168.122.166 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.target_port = 3260 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.target_protocol = iscsi {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.trace_flags = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.unique_fqdn_network = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.use_chap_auth = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_backend_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_clear = zero {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_clear_ionice = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_clear_size = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_reports.file_event_handler = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_reports.log_dir = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.backend_availability_zone = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.backend_host = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.chap_password = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.chap_username = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.chiscsi_conf = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.disk_geometry = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.driver_client_cert = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.driver_data_namespace = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.driver_use_ssl = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.extra_capabilities = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.filter_function = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.goodness_function = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.iser_helper = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.iser_ip_address = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.iser_port = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.iser_target_prefix = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_host = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_login = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_mount_options = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_password = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_private_key = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_share_path = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_ssh_port = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.num_shell_tries = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.nvmet_port_id = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.replication_device = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.report_discard_supported = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.reserved_percentage = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.scst_target_driver = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.storage_protocol = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.target_helper = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.target_ip_address = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.target_port = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.target_prefix = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.target_protocol = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.trace_flags = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.use_chap_auth = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_clear = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_clear_size = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] QuobyteHD.volumes_dir = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.ssl = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_notifications.driver = [] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_notifications.retry = -1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] key_manager.fixed_key = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.barbican_api_version = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.barbican_endpoint = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.barbican_endpoint_type = public {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.barbican_region_name = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.cafile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.collect_timing = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.insecure = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.number_of_retries = 60 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.retry_delay = 1 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.send_service_user_token = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.split_loggers = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.timeout = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack quobyte-client[86370]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.tls_ciphers = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.tls_min_version = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.verify_ssl = True {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican.verify_ssl_path = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.auth_section = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack quobyte-client[86370]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.auth_type = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.cafile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.certfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.collect_timing = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.insecure = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.keyfile = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.split_loggers = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.timeout = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.tls_ciphers = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] barbican_service_user.tls_min_version = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.approle_role_id = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.approle_secret_id = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.auth_method = approle {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.auth_path = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.kv_mountpoint = secret {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.kv_path = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.kv_version = 2 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.namespace = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.root_token_id = **** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.ssl_ca_crt_file = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.timeout = 60.0 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.token_file = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.token_role = None {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.use_ssl = False {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 12:53:33 devstack cinder-volume[86033]: DEBUG oslo_service.backend._eventlet.service [None req-49d463e1-9511-4e0a-93d7-efb87ab39d6e None None] ******************************************************************************** {{(pid=86033) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:33 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:53:33 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:33 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.237s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:33 devstack cinder-volume[86369]: INFO cinder.volume.driver [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG cinder.volume.driver [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7330017089844, 'free_capacity_gb': 1773.7330017089844, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG oslo_db.sqlalchemy.engines [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86369) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 12:53:33 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writer thread running {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.db.api [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Building query based on filter {{(pid=86369) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86369) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:34 devstack cinder-volume[86369]: INFO cinder.keymgr.migration [None req-f035ea55-9799-4c52-9f79-8de920fa2b80 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 12:53:34 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:53:34 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:34 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.229s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:53:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Driver initialization completed successfully. Nov 03 12:53:34 devstack cinder-volume[86369]: INFO cinder.manager [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Initiating service 3 cleanup Nov 03 12:53:34 devstack cinder-volume[86369]: INFO cinder.manager [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Service 3 cleanup completed. Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.service [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Creating RPC server for service cinder-volume {{(pid=86369) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.service [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86369) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 12:53:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:53:34 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:53:34 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:53:34 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Nov 03 12:53:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.229s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:53:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ab97548b-c3a8-4db8-890c-30aa8531d668 None None] Driver post RPC initialization completed successfully. Nov 03 12:53:43 devstack cinder-volume[86033]: DEBUG dbcounter [-] [86033] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:53:44 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:53:44 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:53:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:53:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 6 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:53:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Flow 'volume_create_manager' (bcd4e302-f4d1-4dce-8ef6-f7789b451ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d318ecfb-d38a-4c9c-a64b-661662f3e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d318ecfb-d38a-4c9c-a64b-661662f3e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1062758544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32b90e6-e1ce-4737-bcb2-85c41efd1c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec41559b2f7449b19a141d0d923b6031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:54:32Z,use_quota=True,user_id='346e0d1d0f6a4df4aad27c630c78cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d5f7c3-d9c6-4b66-8835-e1605b3512cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d5f7c3-d9c6-4b66-8835-e1605b3512cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716e53bf-fe2f-442f-a83d-f77c24b22398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716e53bf-fe2f-442f-a83d-f77c24b22398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32b90e6-e1ce-4737-bcb2-85c41efd1c1e', 'volume_name': 'volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be28d631-fdee-4269-95dd-7c9af5eceaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be28d631-fdee-4269-95dd-7c9af5eceaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b38b88-d43a-434f-992f-e86db06b3be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Volume f32b90e6-e1ce-4737-bcb2-85c41efd1c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e', 'volume_size': 1} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1062758544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32b90e6-e1ce-4737-bcb2-85c41efd1c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec41559b2f7449b19a141d0d923b6031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:54:32Z,use_quota=True,user_id='346e0d1d0f6a4df4aad27c630c78cebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Creating volume f32b90e6-e1ce-4737-bcb2-85c41efd1c1e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:54:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:54:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:54:32 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e 1073741824 Nov 03 12:54:32 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:54:33 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e 1073741824" returned: 0 in 0.598s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:54:33 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e Nov 03 12:54:33 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:54:33 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b38b88-d43a-434f-992f-e86db06b3be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb1d6f9-bc99-409f-b45c-1b835e95f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Volume volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e (f32b90e6-e1ce-4737-bcb2-85c41efd1c1e): created successfully Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb1d6f9-bc99-409f-b45c-1b835e95f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Flow 'volume_create_manager' (bcd4e302-f4d1-4dce-8ef6-f7789b451ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:54:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bd788af9-eb91-4c08-8c32-bc0773d2d6f5 tempest-TaggedAttachmentsTest-1588280803 None] Created volume successfully. Nov 03 12:54:43 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:54:43 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:54:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:54:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:54:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:54:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:54:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:54:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:54:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:54:58 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:54:58 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Flow 'volume_create_manager' (ba17a3cb-ead4-4332-b3f8-ddb07f548c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e0ec03-f380-4c63-b3c5-54d4cfb00466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e0ec03-f380-4c63-b3c5-54d4cfb00466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1552749216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad5a5d8-4cfb-4155-a43b-e2ef60edaef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f70e53ae3428ba4f2ff152ebe64f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:54:59Z,use_quota=True,user_id='8d2aa0b687304451bfde07186f19bee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d940a083-ece5-49a7-881e-5067af82c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d940a083-ece5-49a7-881e-5067af82c552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bda1463-a1d4-4fdc-897c-41ce7f9178a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bda1463-a1d4-4fdc-897c-41ce7f9178a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad5a5d8-4cfb-4155-a43b-e2ef60edaef4', 'volume_name': 'volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f45078-0461-43cf-be81-91d457882e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f45078-0461-43cf-be81-91d457882e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6462ed06-4193-485f-815e-1de4551f47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:54:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Volume fad5a5d8-4cfb-4155-a43b-e2ef60edaef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4', 'volume_size': 1} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1552749216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad5a5d8-4cfb-4155-a43b-e2ef60edaef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f70e53ae3428ba4f2ff152ebe64f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:54:59Z,use_quota=True,user_id='8d2aa0b687304451bfde07186f19bee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Creating volume fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:54:59 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:54:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.836s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 6 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:54:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:54:59 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 1073741824 Nov 03 12:54:59 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:00 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 1073741824" returned: 0 in 1.145s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:01 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 Nov 03 12:55:01 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:01 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4" returned: 0 in 0.981s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] <== create_volume: return (2374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:55:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6462ed06-4193-485f-815e-1de4551f47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673c3b16-3b7e-46ca-8808-edd2fab854ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:01 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Volume volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 (fad5a5d8-4cfb-4155-a43b-e2ef60edaef4): created successfully Nov 03 12:55:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673c3b16-3b7e-46ca-8808-edd2fab854ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Flow 'volume_create_manager' (ba17a3cb-ead4-4332-b3f8-ddb07f548c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:55:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-48812689-5dd8-4cd0-8aa5-42ecaeb95d51 tempest-VolumesAdminNegativeTest-455982776 None] Created volume successfully. Nov 03 12:55:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Acquiring lock "cinder-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Lock "cinder-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Acquiring lock "cinder-quobyte-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Lock "cinder-quobyte-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:04 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2ezc1i_2/privsep.sock'] Nov 03 12:55:04 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2ezc1i_2/privsep.sock Nov 03 12:55:04 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 12:55:06 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 12:55:06 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:06 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Spawned new privsep daemon via rootwrap Nov 03 12:55:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Accepted privsep connection to /tmp/tmp2ezc1i_2/privsep.sock {{(pid=86369) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 12:55:06 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 12:55:06 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 12:55:06 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 12:55:06 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87896 Nov 03 12:55:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c44f3-9a7a-4ddc-8e18-75f19633952f]: (2,) {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[72719e4a-b93a-4a68-8c71-aae2cabd3b50]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:06 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 Nov 03 12:55:06 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:07 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4" returned: 0 in 1.034s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:07 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4 Nov 03 12:55:07 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:08 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4" returned: 0 in 0.863s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Lock "cinder-quobyte-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4" released by "delete_volume" :: held 4.350s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:08 devstack cinder-volume[86369]: WARNING cinder.quota [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:55:08 devstack cinder-volume[86369]: WARNING cinder.quota [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:55:08 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Created reservations ['8d3e5c13-4bf0-48e9-96e0-92d7dd580cc2', '1fe660db-d330-4854-8be6-c6002dbedbee', '27cd21d1-e43b-4eca-95b2-192ec0ed57ae', '8800f336-79dc-43ae-8e45-1396275dca00'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:09 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:55:09 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:09 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:55:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Deleted volume successfully. Nov 03 12:55:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-762f3294-f9e3-4ea4-9a6f-85a921653254 tempest-VolumesAdminNegativeTest-455982776 None] Lock "cinder-fad5a5d8-4cfb-4155-a43b-e2ef60edaef4-delete_volume" released by "delete_volume" :: held 5.296s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:15 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:55:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Flow 'volume_create_manager' (4d980b57-efa7-4041-82c2-a72236ed20a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7583a56c-5647-46f0-9784-595054c17976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7583a56c-5647-46f0-9784-595054c17976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-269028743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddae5ac3-8d41-450c-9c4c-8ea58d799e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba319a58509437ab0389478515b3ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:55:16Z,use_quota=True,user_id='b0f6d85345f74ef9bd9daee15cb2abd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a437dd7f-6d68-454c-9c7c-953a64743145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a437dd7f-6d68-454c-9c7c-953a64743145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f914863e-4db5-45f4-9888-65a2b9d6d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f914863e-4db5-45f4-9888-65a2b9d6d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddae5ac3-8d41-450c-9c4c-8ea58d799e3c', 'volume_name': 'volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee4c1e3-dbc7-4b92-8450-8891d10288f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee4c1e3-dbc7-4b92-8450-8891d10288f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68db8858-eeaa-40b4-809c-17f9de90d06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Volume ddae5ac3-8d41-450c-9c4c-8ea58d799e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c', 'volume_size': 1} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-269028743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddae5ac3-8d41-450c-9c4c-8ea58d799e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba319a58509437ab0389478515b3ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:55:16Z,use_quota=True,user_id='b0f6d85345f74ef9bd9daee15cb2abd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Creating volume ddae5ac3-8d41-450c-9c4c-8ea58d799e3c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:55:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:55:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:16 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c 1073741824 Nov 03 12:55:16 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:17 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c 1073741824" returned: 0 in 0.779s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:17 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c Nov 03 12:55:17 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:17 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c" returned: 0 in 0.441s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68db8858-eeaa-40b4-809c-17f9de90d06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39342823-508e-4f4b-b9bc-dcd52b048974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Volume volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c (ddae5ac3-8d41-450c-9c4c-8ea58d799e3c): created successfully Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39342823-508e-4f4b-b9bc-dcd52b048974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Flow 'volume_create_manager' (4d980b57-efa7-4041-82c2-a72236ed20a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:55:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b0e6a93d-67b1-4205-ac96-821bd13331ba tempest-ServerRescueNegativeTestJSON-55164146 None] Created volume successfully. Nov 03 12:55:27 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=3,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:55:27 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:55:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5b2a73f1-f1c1-4ef0-ae74-47596b3b3976 tempest-GroupSnapshotsTest-1211595780 None] Group tempest-GroupSnapshotsTest-Group-982926149: creating Nov 03 12:55:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5b2a73f1-f1c1-4ef0-ae74-47596b3b3976 tempest-GroupSnapshotsTest-1211595780 None] Group tempest-GroupSnapshotsTest-Group-982926149: created successfully Nov 03 12:55:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5b2a73f1-f1c1-4ef0-ae74-47596b3b3976 tempest-GroupSnapshotsTest-1211595780 None] Create group completed successfully. Nov 03 12:55:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Acquiring lock "cinder-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "cinder-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Acquiring lock "cinder-quobyte-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "cinder-quobyte-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f38d76-0a1c-415a-9656-f7e250066f24]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:30 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c Nov 03 12:55:30 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:30 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c" returned: 0 in 0.461s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:30 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c Nov 03 12:55:30 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:31 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c" returned: 0 in 0.657s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "cinder-quobyte-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c" released by "delete_volume" :: held 1.189s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Created reservations ['e53132fb-8a8d-403a-924f-872a4483695f', '1bb12062-3cd9-41f3-b9b7-1742a43c8229', 'd5829162-b04d-4254-a1a0-0813ff2ebf34', '755d2ffd-effa-492e-b0b8-6cf3c36e5d5d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:31 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:55:31 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:31 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.569s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:55:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Deleted volume successfully. Nov 03 12:55:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a10a8276-58ce-4b4b-954e-1b855ae8dc53 tempest-ServerRescueNegativeTestJSON-55164146 None] Lock "cinder-ddae5ac3-8d41-450c-9c4c-8ea58d799e3c-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (30dc7e21-1e5c-472e-be74-0c74244cd5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78946a5-3d68-4f54-95dc-64af9af0a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78946a5-3d68-4f54-95dc-64af9af0a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1092841149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=831787bf-0363-4090-ad7c-39e842171b42,host='devstack@QuobyteHD#QuobyteHD',id=7a3c92fc-3dcb-4b07-8486-bdb737318fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:55:32Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f3de1f-3d43-460c-8737-eb2a28880d64),volume_type_id=23f3de1f-3d43-460c-8737-eb2a28880d64)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f5a426-daf2-467d-8550-b190e3cf3fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f5a426-daf2-467d-8550-b190e3cf3fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1f1fde-5a46-4e5c-a617-ab6908b83278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1f1fde-5a46-4e5c-a617-ab6908b83278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3c92fc-3dcb-4b07-8486-bdb737318fd2', 'volume_name': 'volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1636178-0bc1-42cf-8116-ffc457792eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1636178-0bc1-42cf-8116-ffc457792eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447349b9-216c-4cf2-8e76-f2ae31793410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Volume 7a3c92fc-3dcb-4b07-8486-bdb737318fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2', 'volume_size': 1} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=831787bf-0363-4090-ad7c-39e842171b42,created_at=2026-11-03T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1092841149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=831787bf-0363-4090-ad7c-39e842171b42,host='devstack@QuobyteHD#QuobyteHD',id=7a3c92fc-3dcb-4b07-8486-bdb737318fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:55:32Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f3de1f-3d43-460c-8737-eb2a28880d64),volume_type_id=23f3de1f-3d43-460c-8737-eb2a28880d64)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Creating volume 7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:55:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:55:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:32 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 1073741824 Nov 03 12:55:32 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:33 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 1073741824" returned: 0 in 1.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:33 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 Nov 03 12:55:33 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:34 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:55:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447349b9-216c-4cf2-8e76-f2ae31793410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1253b2ac-2706-4199-b37a-1b91e3704bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:55:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Volume volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 (7a3c92fc-3dcb-4b07-8486-bdb737318fd2): created successfully Nov 03 12:55:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1253b2ac-2706-4199-b37a-1b91e3704bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:55:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (30dc7e21-1e5c-472e-be74-0c74244cd5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:55:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-40fb6aeb-3d40-4cc9-adb8-ecb3ab62d96d tempest-GroupSnapshotsTest-1211595780 None] Created volume successfully. Nov 03 12:55:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] GroupSnapshot 22fb399e-43ad-4eef-a3c3-7ec9de331e6d: creating. Nov 03 12:55:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Group snapshot 22fb399e-43ad-4eef-a3c3-7ec9de331e6d: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 12:55:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Creating offline snapshot 3cc0a254-af92-4a5c-97b0-469fe5bba8d0 of volume 7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:55:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c452c-6232-4edc-ba66-ea9037dcc516]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:35 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 Nov 03 12:55:35 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:36 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" returned: 0 in 0.524s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:36 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 1G Nov 03 12:55:36 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:36 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 1G" returned: 0 in 0.528s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:36 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 Nov 03 12:55:36 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:37 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:37 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:55:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:37 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 Nov 03 12:55:37 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:37 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:37 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.info Nov 03 12:55:37 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:38 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.info" returned: 0 in 0.308s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:38 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:55:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:38 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.info Nov 03 12:55:38 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:38 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.info" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7bf17334-2c6a-4f02-a9c4-0a5d1a44fd92 tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 22fb399e-43ad-4eef-a3c3-7ec9de331e6d: created successfully Nov 03 12:55:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-3cc0a254-af92-4a5c-97b0-469fe5bba8d0-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3cc0a254-af92-4a5c-97b0-469fe5bba8d0-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Creating volume 3b65ef5d-4796-4121-bb66-8faa8d6d92bb from snapshot 3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] snapshot: 3cc0a254-af92-4a5c-97b0-469fe5bba8d0, volume: 3b65ef5d-4796-4121-bb66-8faa8d6d92bb, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089f0f4-665e-4d2a-88ae-86a817025c9e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:40 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 Nov 03 12:55:40 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:40 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0" returned: 0 in 0.548s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5392fcaf-a55d-4d6e-81e7-c246ad25677e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:40 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 Nov 03 12:55:40 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:41 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:55:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:55:41 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 12:55:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:41 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb Nov 03 12:55:41 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:49 devstack cinder-volume[86369]: WARNING py.warnings [req-c8d40d88-f601-4fa3-a2e1-0489acb7ad21 req-6f5e60cb-cdd0-43c1-93b9-6b95a8e97e87 tempest-TaggedAttachmentsTest-1588280803 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 03 12:55:49 devstack cinder-volume[86369]: .first() Nov 03 12:55:49 devstack cinder-volume[86369]: Nov 03 12:55:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c8d40d88-f601-4fa3-a2e1-0489acb7ad21 req-6f5e60cb-cdd0-43c1-93b9-6b95a8e97e87 tempest-TaggedAttachmentsTest-1588280803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:50 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=15 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:55:51 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" returned: 0 in 9.867s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2, size 1024.00 MB, duration 9.87 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:55:51 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Converted 1024.00 MB image at 103.77 MB/s Nov 03 12:55:51 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:51 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb Nov 03 12:55:51 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:51 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" released by "_copy_volume_from_snapshot" :: held 11.292s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3cc0a254-af92-4a5c-97b0-469fe5bba8d0-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" released by "_create_volume_from_snapshot" :: held 11.381s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.416s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c8d40d88-f601-4fa3-a2e1-0489acb7ad21 req-6f5e60cb-cdd0-43c1-93b9-6b95a8e97e87 tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.865s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c8d40d88-f601-4fa3-a2e1-0489acb7ad21 req-6f5e60cb-cdd0-43c1-93b9-6b95a8e97e87 tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.159s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c8d40d88-f601-4fa3-a2e1-0489acb7ad21 req-6f5e60cb-cdd0-43c1-93b9-6b95a8e97e87 tempest-TaggedAttachmentsTest-1588280803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '908b22cc-2232-4337-8e08-2b3101d590cc', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:55:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cedfd837-fa74-4cc4-82a6-a3be6babe2a0 tempest-GroupSnapshotsTest-1211595780 None] Create group from source-snapshot-22fb399e-43ad-4eef-a3c3-7ec9de331e6d completed successfully. Nov 03 12:55:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c8d40d88-f601-4fa3-a2e1-0489acb7ad21 req-6f5e60cb-cdd0-43c1-93b9-6b95a8e97e87 tempest-TaggedAttachmentsTest-1588280803 None] attachment_update completed successfully. Nov 03 12:55:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ab079f-625c-4c78-a7ac-69c5be47e918]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:52 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb Nov 03 12:55:52 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:53 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" returned: 0 in 0.530s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:53 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb Nov 03 12:55:53 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:53 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3b65ef5d-4796-4121-bb66-8faa8d6d92bb" released by "delete_volume" :: held 0.914s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['48849cb5-d3ae-4a79-b3e3-d29022907a35'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:55:53 devstack cinder-volume[86369]: WARNING cinder.quota [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1886714966 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1886714966, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:55:53 devstack cinder-volume[86369]: WARNING cinder.quota [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1886714966 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1886714966, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['f092fbe9-c3ad-46dd-b1bd-d794e214c458', '6695f69d-53fa-49fa-a0f5-5622442a8423', '378165fe-fbe8-47cc-819e-7a9abcdfaddc', '1578fa1d-816f-473b-beb7-19a8219995ba'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:53 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:55:53 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 22fb399e-43ad-4eef-a3c3-7ec9de331e6d: deleting Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 22fb399e-43ad-4eef-a3c3-7ec9de331e6d: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-3cc0a254-af92-4a5c-97b0-469fe5bba8d0" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3cc0a254-af92-4a5c-97b0-469fe5bba8d0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Deleting offline snapshot 3cc0a254-af92-4a5c-97b0-469fe5bba8d0 of volume 7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:55:54 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] snapshot_file for this snap is: volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.414s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:55:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-966b6751-dfcf-4576-b31c-1101e79a6332 tempest-GroupSnapshotsTest-1211595780 None] Delete group completed successfully. Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2266bb8e-12c2-43a6-aa2f-e2d523f50a15]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:54 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 Nov 03 12:55:54 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:54 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[845fc9f3-7a6e-443f-a95d-62f7d4a76165]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:55 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 Nov 03 12:55:55 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:55 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" returned: 0 in 0.620s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:55 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 Nov 03 12:55:55 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:56 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0" returned: 0 in 0.521s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:56 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0 Nov 03 12:55:56 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:56 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2.3cc0a254-af92-4a5c-97b0-469fe5bba8d0" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-3cc0a254-af92-4a5c-97b0-469fe5bba8d0" released by "_delete_snapshot" :: held 2.097s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" released by "delete_snapshot" :: held 2.142s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:56 devstack cinder-volume[86369]: WARNING cinder.quota [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1886714966 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1886714966, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:55:56 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['36fe4210-ba08-4a65-979b-c339471ed3d8', 'd23bc2d1-b23f-4da7-9959-9cef6ab27915', 'f8f6678c-5a12-459e-8386-c47523c7675d', 'd5adf2bb-c51c-4999-b4c4-6c0fa444c4af'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:55:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-16f8d790-a136-4cbd-b4e7-7376afdc2923 tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 22fb399e-43ad-4eef-a3c3-7ec9de331e6d: deleted successfully Nov 03 12:55:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-9f779609-9af0-4a12-bfb1-48e841e1a767 req-50c6bb22-2a67-4e56-bf17-f4c2cc33915f tempest-TaggedAttachmentsTest-1588280803 None] Terminate volume connection completed successfully. Nov 03 12:55:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-9f779609-9af0-4a12-bfb1-48e841e1a767 req-50c6bb22-2a67-4e56-bf17-f4c2cc33915f tempest-TaggedAttachmentsTest-1588280803 None] Deleting attachment 908b22cc-2232-4337-8e08-2b3101d590cc. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:55:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b96cb-8882-4a0e-8ab9-9354fabe511c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:58 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 Nov 03 12:55:58 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:58 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:55:58 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:58 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" returned: 0 in 0.677s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:58 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2 Nov 03 12:55:58 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:59 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:55:59 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-7a3c92fc-3dcb-4b07-8486-bdb737318fd2" released by "delete_volume" :: held 1.128s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['6a54fd55-2492-439f-97a3-da392e8201cd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:55:59 devstack cinder-volume[86369]: WARNING cinder.db.api [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1886714966'] Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['219c0595-05f6-43e8-8f8f-537d59a05515', 'ee80def8-e2e2-4d8f-90fe-d2a3b9c53357', 'ff5af11f-10ee-4f62-a016-1664f489ab7e', '259e87e4-545d-4caa-b6ab-41d940d7c999'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:55:59 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:55:59 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:55:59 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:55:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:55:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-629af154-06de-40e8-8835-7c38ed23c872 tempest-GroupSnapshotsTest-1211595780 None] Delete group completed successfully. Nov 03 12:56:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e07990b2-57f6-4070-9f6a-c1c7fe9a4633 tempest-GroupSnapshotsTest-1211595780 None] Group tempest-GroupSnapshotsTest-Group-1885923687: creating Nov 03 12:56:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e07990b2-57f6-4070-9f6a-c1c7fe9a4633 tempest-GroupSnapshotsTest-1211595780 None] Group tempest-GroupSnapshotsTest-Group-1885923687: created successfully Nov 03 12:56:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e07990b2-57f6-4070-9f6a-c1c7fe9a4633 tempest-GroupSnapshotsTest-1211595780 None] Create group completed successfully. Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (216c88a8-b0d3-44e5-9937-80bb9d81ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c8697d-e3bd-4d42-9d7d-937786d3aa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c8697d-e3bd-4d42-9d7d-937786d3aa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1176503716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495763ac-8812-49bc-b876-002dad5f551e,host='devstack@QuobyteHD#QuobyteHD',id=a87d1013-6591-4343-8e30-037c5ffda2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:04Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09736d39-887d-4e5d-aaa2-f2ff447137a0),volume_type_id=09736d39-887d-4e5d-aaa2-f2ff447137a0)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ddc34a-07e3-4a20-9e92-65d48193738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ddc34a-07e3-4a20-9e92-65d48193738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5b3eb1-0d75-4ad4-9f25-9edb65401a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5b3eb1-0d75-4ad4-9f25-9edb65401a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87d1013-6591-4343-8e30-037c5ffda2ae', 'volume_name': 'volume-a87d1013-6591-4343-8e30-037c5ffda2ae', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff022137-1e36-4e74-8c02-34ae95c96ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff022137-1e36-4e74-8c02-34ae95c96ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af359fb0-7efb-4470-aad0-057afec163f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Volume a87d1013-6591-4343-8e30-037c5ffda2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87d1013-6591-4343-8e30-037c5ffda2ae', 'volume_size': 1} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=495763ac-8812-49bc-b876-002dad5f551e,created_at=2026-11-03T11:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1176503716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495763ac-8812-49bc-b876-002dad5f551e,host='devstack@QuobyteHD#QuobyteHD',id=a87d1013-6591-4343-8e30-037c5ffda2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:04Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09736d39-887d-4e5d-aaa2-f2ff447137a0),volume_type_id=09736d39-887d-4e5d-aaa2-f2ff447137a0)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Creating volume a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:56:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:56:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:03 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae 1073741824 Nov 03 12:56:03 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:04 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae 1073741824" returned: 0 in 0.597s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:04 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae Nov 03 12:56:04 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:04 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af359fb0-7efb-4470-aad0-057afec163f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87d1013-6591-4343-8e30-037c5ffda2ae', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df128c7-7923-4f51-81dd-8025c0124791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Volume volume-a87d1013-6591-4343-8e30-037c5ffda2ae (a87d1013-6591-4343-8e30-037c5ffda2ae): created successfully Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df128c7-7923-4f51-81dd-8025c0124791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (216c88a8-b0d3-44e5-9937-80bb9d81ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4ac03c63-870d-4e32-8969-fb2f5a872913 tempest-GroupSnapshotsTest-1211595780 None] Created volume successfully. Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (df9ca6c6-106b-4b87-a671-3e98bf028caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b563b7ab-048e-46a8-a645-b2adfdfdb339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b563b7ab-048e-46a8-a645-b2adfdfdb339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-711874379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495763ac-8812-49bc-b876-002dad5f551e,host='devstack@QuobyteHD#QuobyteHD',id=ca035eae-6055-423a-924c-0de0f0055dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:07Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09736d39-887d-4e5d-aaa2-f2ff447137a0),volume_type_id=09736d39-887d-4e5d-aaa2-f2ff447137a0)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d19dbf-fb3a-47e8-8fa0-0a2619bd6d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d19dbf-fb3a-47e8-8fa0-0a2619bd6d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51b22df-c3dd-4118-ac4b-887583e8c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51b22df-c3dd-4118-ac4b-887583e8c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca035eae-6055-423a-924c-0de0f0055dbb', 'volume_name': 'volume-ca035eae-6055-423a-924c-0de0f0055dbb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c0576-5950-44c9-ae60-e5091916b4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c0576-5950-44c9-ae60-e5091916b4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd559503-8520-4a05-8efa-c5365e60f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Volume ca035eae-6055-423a-924c-0de0f0055dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca035eae-6055-423a-924c-0de0f0055dbb', 'volume_size': 1} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=495763ac-8812-49bc-b876-002dad5f551e,created_at=2026-11-03T11:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-711874379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495763ac-8812-49bc-b876-002dad5f551e,host='devstack@QuobyteHD#QuobyteHD',id=ca035eae-6055-423a-924c-0de0f0055dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:07Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09736d39-887d-4e5d-aaa2-f2ff447137a0),volume_type_id=09736d39-887d-4e5d-aaa2-f2ff447137a0)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Creating volume ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:56:07 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:07 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb 1073741824 Nov 03 12:56:07 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:07 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb 1073741824" returned: 0 in 0.576s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:07 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb Nov 03 12:56:07 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:08 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:56:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd559503-8520-4a05-8efa-c5365e60f34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca035eae-6055-423a-924c-0de0f0055dbb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc872cf-0451-4305-8a39-f9f9e5899894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Volume volume-ca035eae-6055-423a-924c-0de0f0055dbb (ca035eae-6055-423a-924c-0de0f0055dbb): created successfully Nov 03 12:56:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc872cf-0451-4305-8a39-f9f9e5899894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (df9ca6c6-106b-4b87-a671-3e98bf028caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fde231dc-4576-4be6-8f06-cf3c0b286ee3 tempest-GroupSnapshotsTest-1211595780 None] Created volume successfully. Nov 03 12:56:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-82e9a588-6ec9-4197-b5dc-4794bd4d0ffd tempest-GroupSnapshotsTest-1211595780 None] Update group completed successfully. Nov 03 12:56:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-91dff587-a3c1-470f-942b-e19f2660d8e3 tempest-GroupSnapshotsTest-1211595780 None] Update group completed successfully. Nov 03 12:56:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-523ec25f-6e27-4aba-890b-d6754d199571 tempest-GroupSnapshotsTest-1211595780 None] Update group completed successfully. Nov 03 12:56:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-33a1fecc-a917-4bb2-81df-bacc1104d699 tempest-GroupSnapshotsTest-1211595780 None] Update group completed successfully. Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Acquiring lock "cinder-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Lock "cinder-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Acquiring lock "cinder-quobyte-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Lock "cinder-quobyte-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5d070a-280e-4ef0-b907-3b96389b27b3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:13 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e Nov 03 12:56:13 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:13 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e" returned: 0 in 0.585s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:14 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e Nov 03 12:56:14 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:14 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Lock "cinder-quobyte-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e" released by "delete_volume" :: held 1.097s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] GroupSnapshot 37116627-8562-41a5-a4c5-0592c8eb0bb0: creating. Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Group snapshot 37116627-8562-41a5-a4c5-0592c8eb0bb0: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Creating offline snapshot 061e726f-00f7-40de-a1fe-bdd8921f8347 of volume a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b0598e-a624-4ede-8f53-c9e89df5cb25]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Created reservations ['3d1af339-6d91-4a70-9cd0-c3e4c29fdb36', '968df542-8a6b-4643-bef5-b5c37a9bb819', '70966dbd-d238-4c9f-bc80-0d73a68e1e08', '3aace21b-2e0a-4141-b0b9-5a2e7d6c4a66'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:14 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae Nov 03 12:56:14 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:14 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:56:14 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:15 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.372s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:15 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:56:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Deleted volume successfully. Nov 03 12:56:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f3cff125-89fa-4d8c-9376-396d964935ce tempest-TaggedAttachmentsTest-1588280803 None] Lock "cinder-f32b90e6-e1ce-4737-bcb2-85c41efd1c1e-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:15 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae" returned: 0 in 0.560s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:15 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 1G Nov 03 12:56:15 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:15 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 1G" returned: 0 in 0.677s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a87d1013-6591-4343-8e30-037c5ffda2ae -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:15 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a87d1013-6591-4343-8e30-037c5ffda2ae -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 Nov 03 12:56:15 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:16 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a87d1013-6591-4343-8e30-037c5ffda2ae -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347" returned: 0 in 0.585s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:16 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:56:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:16 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 Nov 03 12:56:16 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:16 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:16 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.info Nov 03 12:56:16 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Flow 'volume_create_manager' (75bc6f09-49e6-46ed-875c-d8eb79f78a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0493aa9-f443-4402-9113-052fc2024c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0493aa9-f443-4402-9113-052fc2024c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2030112924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ecbd0-af22-4ade-be25-d6e390a3a36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e29fc8cf814432b6b25b3309643475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:17Z,use_quota=True,user_id='f8536151fcd7477ba9218fa0982a3271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068856ad-e6e6-4776-aa57-d4d690ed1cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068856ad-e6e6-4776-aa57-d4d690ed1cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c6389e-b7af-4ffa-b862-e482265f0cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c6389e-b7af-4ffa-b862-e482265f0cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1ecbd0-af22-4ade-be25-d6e390a3a36d', 'volume_name': 'volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93f37d6-28ef-4af8-944b-bcd083e0a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93f37d6-28ef-4af8-944b-bcd083e0a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9318bc-8144-46bf-9bc4-8fe906575558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Volume 2a1ecbd0-af22-4ade-be25-d6e390a3a36d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d', 'volume_size': 1} Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:17 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.info" returned: 0 in 0.767s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:17 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:56:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:17 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.info Nov 03 12:56:17 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:18 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.info" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.503s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Creating offline snapshot a13c4d54-16f1-4485-bffb-9fffccdff3a5 of volume ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[938eb0fb-5c31-41d7-a540-80de872a1e63]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:18 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb Nov 03 12:56:18 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:18 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb" returned: 0 in 0.752s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:18 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 1G Nov 03 12:56:18 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:19 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 1G" returned: 0 in 0.463s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca035eae-6055-423a-924c-0de0f0055dbb -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:19 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca035eae-6055-423a-924c-0de0f0055dbb -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 Nov 03 12:56:19 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:19 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca035eae-6055-423a-924c-0de0f0055dbb -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:19 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:56:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:19 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 Nov 03 12:56:19 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:20 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:20 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.info Nov 03 12:56:20 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:20 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.info" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:20 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:20 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.info Nov 03 12:56:20 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:20 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.info" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.515s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2030112924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ecbd0-af22-4ade-be25-d6e390a3a36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e29fc8cf814432b6b25b3309643475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:17Z,use_quota=True,user_id='f8536151fcd7477ba9218fa0982a3271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Creating volume 2a1ecbd0-af22-4ade-be25-d6e390a3a36d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:56:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:56:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:20 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d 1073741824 Nov 03 12:56:20 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7b7b1dc5-9316-4707-9087-fdc3fc94a587 tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 37116627-8562-41a5-a4c5-0592c8eb0bb0: created successfully Nov 03 12:56:21 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d 1073741824" returned: 0 in 1.048s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:22 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d Nov 03 12:56:22 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 37116627-8562-41a5-a4c5-0592c8eb0bb0: deleting Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 37116627-8562-41a5-a4c5-0592c8eb0bb0: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-a87d1013-6591-4343-8e30-037c5ffda2ae" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:22 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d" returned: 0 in 0.690s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-a87d1013-6591-4343-8e30-037c5ffda2ae" acquired by "delete_snapshot" :: waited 0.079s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-061e726f-00f7-40de-a1fe-bdd8921f8347" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9318bc-8144-46bf-9bc4-8fe906575558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aab188-c706-4e15-b636-d58a4ada7a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-061e726f-00f7-40de-a1fe-bdd8921f8347" acquired by "_delete_snapshot" :: waited 0.139s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Deleting offline snapshot 061e726f-00f7-40de-a1fe-bdd8921f8347 of volume a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:56:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] snapshot_file for this snap is: volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:56:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Volume volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d (2a1ecbd0-af22-4ade-be25-d6e390a3a36d): created successfully Nov 03 12:56:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aab188-c706-4e15-b636-d58a4ada7a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Flow 'volume_create_manager' (75bc6f09-49e6-46ed-875c-d8eb79f78a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680119d-a75c-4c68-b179-fbd618be975f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-00b7580b-1b63-4457-aecc-5c6520d52489 tempest-DeleteServersTestJSON-117493490 None] Created volume successfully. Nov 03 12:56:23 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 Nov 03 12:56:23 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:23 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347" returned: 0 in 0.891s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a87d1013-6591-4343-8e30-037c5ffda2ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:56:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0e0753-95d4-43c0-ba68-563ede294f2d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:24 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae Nov 03 12:56:24 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:24 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae" returned: 0 in 0.864s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:25 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 Nov 03 12:56:25 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:25 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347" returned: 0 in 0.777s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:25 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347 Nov 03 12:56:25 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:26 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae.061e726f-00f7-40de-a1fe-bdd8921f8347" returned: 0 in 0.639s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-061e726f-00f7-40de-a1fe-bdd8921f8347" released by "_delete_snapshot" :: held 3.624s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-a87d1013-6591-4343-8e30-037c5ffda2ae" released by "delete_snapshot" :: held 3.794s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-ca035eae-6055-423a-924c-0de0f0055dbb" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-ca035eae-6055-423a-924c-0de0f0055dbb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-a13c4d54-16f1-4485-bffb-9fffccdff3a5" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-a13c4d54-16f1-4485-bffb-9fffccdff3a5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Deleting offline snapshot a13c4d54-16f1-4485-bffb-9fffccdff3a5 of volume ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] snapshot_file for this snap is: volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce9b57-e61f-4481-8d54-63bd29d00c49]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-69c22b0c-d3ae-4656-8439-482f0a433066 req-7193e7ee-5450-4dcc-8efe-d383ff0e579b tempest-DeleteServersTestJSON-117493490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-69c22b0c-d3ae-4656-8439-482f0a433066 req-7193e7ee-5450-4dcc-8efe-d383ff0e579b tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-69c22b0c-d3ae-4656-8439-482f0a433066 req-7193e7ee-5450-4dcc-8efe-d383ff0e579b tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-69c22b0c-d3ae-4656-8439-482f0a433066 req-7193e7ee-5450-4dcc-8efe-d383ff0e579b tempest-DeleteServersTestJSON-117493490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18edb72d-d57b-4c74-aedc-a62c5526e5f4', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:56:27 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 Nov 03 12:56:27 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-69c22b0c-d3ae-4656-8439-482f0a433066 req-7193e7ee-5450-4dcc-8efe-d383ff0e579b tempest-DeleteServersTestJSON-117493490 None] attachment_update completed successfully. Nov 03 12:56:27 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5" returned: 0 in 1.038s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca035eae-6055-423a-924c-0de0f0055dbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:56:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[14be0b6a-73fa-4ccf-8b7a-251c0f845ec1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:28 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb Nov 03 12:56:28 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:28 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb" returned: 0 in 0.778s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:28 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 Nov 03 12:56:28 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:29 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5" returned: 0 in 0.663s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:29 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5 Nov 03 12:56:29 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:29 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb.a13c4d54-16f1-4485-bffb-9fffccdff3a5" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-a13c4d54-16f1-4485-bffb-9fffccdff3a5" released by "_delete_snapshot" :: held 3.205s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-ca035eae-6055-423a-924c-0de0f0055dbb" released by "delete_snapshot" :: held 3.252s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:29 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=78,cinder:SELECT=85,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:56:30 devstack cinder-volume[86369]: WARNING cinder.quota [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-67923804 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-67923804, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:56:30 devstack cinder-volume[86369]: WARNING cinder.quota [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-67923804 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-67923804, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:56:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['7c642fc7-b422-4634-9f5d-a0eec197d92f', '42027549-2456-4825-b8cc-37d6fcff5b9e', '274bcac4-0d44-480e-ac0d-1adc83e9c09b', '4d3e64e6-a08a-40a7-9b7c-9d5670971015'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['50776bb4-e1f4-482b-948b-2bddfc5b403c', 'f469c332-79d8-4c0f-9ced-7895c8fa59a1', 'e47bd6d0-5fe0-487c-a76c-1fe18af18482', '45bd72b7-c620-4f4e-b04f-52d1d7e7f013'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aa4197da-fdb3-4d37-95bd-f81d726bbc5c tempest-GroupSnapshotsTest-1211595780 None] group_snapshot 37116627-8562-41a5-a4c5-0592c8eb0bb0: deleted successfully Nov 03 12:56:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-a87d1013-6591-4343-8e30-037c5ffda2ae" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-a87d1013-6591-4343-8e30-037c5ffda2ae" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea29f623-81e7-462a-a620-7d745c938934]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:32 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae Nov 03 12:56:32 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:32 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae" returned: 0 in 0.682s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:32 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae Nov 03 12:56:32 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:33 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a87d1013-6591-4343-8e30-037c5ffda2ae" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-a87d1013-6591-4343-8e30-037c5ffda2ae" released by "delete_volume" :: held 1.334s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-ca035eae-6055-423a-924c-0de0f0055dbb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-ca035eae-6055-423a-924c-0de0f0055dbb" acquired by "delete_volume" :: waited 0.064s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[472ebb98-231c-40ee-ae74-6f2ebc5384c2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:33 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb Nov 03 12:56:33 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:34 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb" returned: 0 in 0.670s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:34 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb Nov 03 12:56:34 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:34 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ca035eae-6055-423a-924c-0de0f0055dbb" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-ca035eae-6055-423a-924c-0de0f0055dbb" released by "delete_volume" :: held 1.267s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['d4b844bd-2b31-44d1-8f5e-840997c3d9f2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:34 devstack cinder-volume[86369]: WARNING cinder.quota [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-67923804 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-67923804, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:56:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['3b67d678-237c-48c1-8e76-0ce1b03fbc44', '23807b9f-f102-43a1-8171-6d2cb9804c42', 'c86c31c6-c39b-42b3-83c7-d5963c60f3e9', 'b0aeaa6b-ac03-4e2c-9421-28a342466b9e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['d7b57794-6f07-4635-9745-995b57a0dc1b', '4e318e81-a1d4-40a8-acff-bf2c5772c322', '521e54a4-d078-4a72-ae22-3524d310f557', 'f8b093e4-61d1-4447-9232-4bba6988ea1c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-8fe23139-7cbc-4568-8000-8efebb9ee664 req-47c23e48-9bf5-4feb-bacc-1b94345b32fa tempest-DeleteServersTestJSON-117493490 None] Terminate volume connection completed successfully. Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-8fe23139-7cbc-4568-8000-8efebb9ee664 req-47c23e48-9bf5-4feb-bacc-1b94345b32fa tempest-DeleteServersTestJSON-117493490 None] Deleting attachment 18edb72d-d57b-4c74-aedc-a62c5526e5f4. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:35 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:56:35 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:35 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.517s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:56:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-746ee66c-6eca-4b02-b6e4-39cd28befcc0 tempest-GroupSnapshotsTest-1211595780 None] Delete group completed successfully. Nov 03 12:56:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-825b0d15-25f2-48ae-8864-83fdd7a2cdb0 tempest-GroupSnapshotsTest-1211595780 None] Group tempest-GroupSnapshotsTest-Group-197582795: creating Nov 03 12:56:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-825b0d15-25f2-48ae-8864-83fdd7a2cdb0 tempest-GroupSnapshotsTest-1211595780 None] Group tempest-GroupSnapshotsTest-Group-197582795: created successfully Nov 03 12:56:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-825b0d15-25f2-48ae-8864-83fdd7a2cdb0 tempest-GroupSnapshotsTest-1211595780 None] Create group completed successfully. Nov 03 12:56:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Acquiring lock "cinder-2a1ecbd0-af22-4ade-be25-d6e390a3a36d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Lock "cinder-2a1ecbd0-af22-4ade-be25-d6e390a3a36d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Acquiring lock "cinder-quobyte-2a1ecbd0-af22-4ade-be25-d6e390a3a36d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Lock "cinder-quobyte-2a1ecbd0-af22-4ade-be25-d6e390a3a36d" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[921fd91d-26f0-4336-929d-64e7a4606441]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:37 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d Nov 03 12:56:37 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:38 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d" returned: 0 in 0.768s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:38 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d Nov 03 12:56:38 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:39 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a1ecbd0-af22-4ade-be25-d6e390a3a36d" returned: 0 in 0.527s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Lock "cinder-quobyte-2a1ecbd0-af22-4ade-be25-d6e390a3a36d" released by "delete_volume" :: held 1.393s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Created reservations ['03970849-68ad-44a8-af75-14702b4d2ffa', 'a24c964c-4507-4f4c-a10e-f70787a1c31a', '65fe56b1-d91c-4af9-b6aa-8b05bea77c23', '2b5821e4-d131-4566-b3b0-4e39bc3702dc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (2a92b04c-d9ce-4503-b9e7-e2ca8ecc3c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cefae9b-53cc-4b81-a421-b3287f5f6495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cefae9b-53cc-4b81-a421-b3287f5f6495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266691053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e250b8fb-970d-49e8-be76-43370a42ef2d,host='devstack@QuobyteHD#QuobyteHD',id=2841a38b-ae80-41d5-901b-75a61fcfb143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:39Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a49867d-e884-4e95-bedd-caee4f474815),volume_type_id=7a49867d-e884-4e95-bedd-caee4f474815)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51f141a-84fc-4a3c-83df-52ba4a68aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51f141a-84fc-4a3c-83df-52ba4a68aefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa59807-ec35-4524-b619-04a99d1b6eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa59807-ec35-4524-b619-04a99d1b6eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2841a38b-ae80-41d5-901b-75a61fcfb143', 'volume_name': 'volume-2841a38b-ae80-41d5-901b-75a61fcfb143', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abf59ee-6649-464b-88d8-c3a36645b91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abf59ee-6649-464b-88d8-c3a36645b91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4feebf-28d3-4cb5-ae79-2c227713a2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Volume 2841a38b-ae80-41d5-901b-75a61fcfb143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2841a38b-ae80-41d5-901b-75a61fcfb143', 'volume_size': 1} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e250b8fb-970d-49e8-be76-43370a42ef2d,created_at=2026-11-03T11:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266691053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e250b8fb-970d-49e8-be76-43370a42ef2d,host='devstack@QuobyteHD#QuobyteHD',id=2841a38b-ae80-41d5-901b-75a61fcfb143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e07eb4f2cb34b9dbebaeacd70af334a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:39Z,use_quota=True,user_id='73b2cb4fbe884cbaa0c2bcc5e6ce0273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a49867d-e884-4e95-bedd-caee4f474815),volume_type_id=7a49867d-e884-4e95-bedd-caee4f474815)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Creating volume 2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:56:39 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:39 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 1073741824 Nov 03 12:56:39 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:39 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:56:39 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:39 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:56:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Deleted volume successfully. Nov 03 12:56:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-106b97a3-78f7-4cb4-ba93-566c2967bf9e tempest-DeleteServersTestJSON-117493490 None] Lock "cinder-2a1ecbd0-af22-4ade-be25-d6e390a3a36d-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:40 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 1073741824" returned: 0 in 0.709s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:40 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 Nov 03 12:56:40 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:40 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143" returned: 0 in 0.353s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4feebf-28d3-4cb5-ae79-2c227713a2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2841a38b-ae80-41d5-901b-75a61fcfb143', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c616a56-9d4b-469a-bc36-4ae581244f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:40 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Volume volume-2841a38b-ae80-41d5-901b-75a61fcfb143 (2841a38b-ae80-41d5-901b-75a61fcfb143): created successfully Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c616a56-9d4b-469a-bc36-4ae581244f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Flow 'volume_create_manager' (2a92b04c-d9ce-4503-b9e7-e2ca8ecc3c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-74e37033-a967-4a18-bb44-978399409ab5 tempest-GroupSnapshotsTest-1211595780 None] Created volume successfully. Nov 03 12:56:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] GroupSnapshot c2da320b-d332-4b4a-9a0c-ba41d1ecce2d: creating. Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Group snapshot c2da320b-d332-4b4a-9a0c-ba41d1ecce2d: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Creating offline snapshot aa46a95c-f91e-4808-bdec-1157578a005d of volume 2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a41ca7-6fd5-4f44-9fcc-23c2c518d1f2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:42 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 Nov 03 12:56:42 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:42 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:42 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d 1G Nov 03 12:56:42 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:43 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d 1G" returned: 0 in 0.516s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2841a38b-ae80-41d5-901b-75a61fcfb143 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:43 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2841a38b-ae80-41d5-901b-75a61fcfb143 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d Nov 03 12:56:43 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:43 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2841a38b-ae80-41d5-901b-75a61fcfb143 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d" returned: 0 in 0.459s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:43 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:56:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:43 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d Nov 03 12:56:43 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:43 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:44 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.info Nov 03 12:56:44 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:44 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.info" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:44 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:56:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:44 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.info Nov 03 12:56:44 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:44 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.info" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3433ba4c-8b01-4993-8ccc-e2ae6a5b1cf3 tempest-GroupSnapshotsTest-1211595780 None] group_snapshot c2da320b-d332-4b4a-9a0c-ba41d1ecce2d: created successfully Nov 03 12:56:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] group_snapshot c2da320b-d332-4b4a-9a0c-ba41d1ecce2d: deleting Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] group_snapshot c2da320b-d332-4b4a-9a0c-ba41d1ecce2d: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-2841a38b-ae80-41d5-901b-75a61fcfb143" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-2841a38b-ae80-41d5-901b-75a61fcfb143" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-aa46a95c-f91e-4808-bdec-1157578a005d" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-aa46a95c-f91e-4808-bdec-1157578a005d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Deleting offline snapshot aa46a95c-f91e-4808-bdec-1157578a005d of volume 2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] snapshot_file for this snap is: volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[11153a36-0385-445d-9151-d0b576467e19]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:45 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d Nov 03 12:56:45 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:46 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d" returned: 0 in 0.492s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2841a38b-ae80-41d5-901b-75a61fcfb143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:56:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d084ff2b-6dc1-4012-9a3f-5579f91501de]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:46 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 Nov 03 12:56:46 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:46 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143" returned: 0 in 0.570s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:46 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d Nov 03 12:56:46 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:47 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d" returned: 0 in 0.569s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:47 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d Nov 03 12:56:47 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:47 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143.aa46a95c-f91e-4808-bdec-1157578a005d" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-aa46a95c-f91e-4808-bdec-1157578a005d" released by "_delete_snapshot" :: held 2.185s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-2841a38b-ae80-41d5-901b-75a61fcfb143" released by "delete_snapshot" :: held 2.225s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:56:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Flow 'volume_create_manager' (69186fb6-a83d-4c52-bde5-2f6d9d5ca300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3d8807-d3b7-46af-b530-5ecbc1ee8fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3d8807-d3b7-46af-b530-5ecbc1ee8fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1453726026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b694cf7-0d9d-43ad-9751-112225913599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f204f39baadd497ea9b3303f1879e031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:48Z,use_quota=True,user_id='f79c6113b97b495fa4fd94f5aea2ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc9f406-592c-4ae6-8e7e-39acb2013897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc9f406-592c-4ae6-8e7e-39acb2013897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf79e3b1-b444-4e4e-8792-bd9f8f7c6b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf79e3b1-b444-4e4e-8792-bd9f8f7c6b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b694cf7-0d9d-43ad-9751-112225913599', 'volume_name': 'volume-7b694cf7-0d9d-43ad-9751-112225913599', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431ad0b4-a942-4ba0-b945-8fe6e7a0bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431ad0b4-a942-4ba0-b945-8fe6e7a0bc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367dc5c7-b25c-4061-98bd-0d088c22114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Volume 7b694cf7-0d9d-43ad-9751-112225913599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b694cf7-0d9d-43ad-9751-112225913599', 'volume_size': 1} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1453726026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b694cf7-0d9d-43ad-9751-112225913599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f204f39baadd497ea9b3303f1879e031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:48Z,use_quota=True,user_id='f79c6113b97b495fa4fd94f5aea2ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Creating volume 7b694cf7-0d9d-43ad-9751-112225913599 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:56:48 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:48 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 1073741824 Nov 03 12:56:48 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:48 devstack cinder-volume[86369]: WARNING cinder.quota [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1675268698 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1675268698, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:56:48 devstack cinder-volume[86369]: WARNING cinder.quota [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1675268698 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1675268698, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['ce1e18ac-643d-4475-9c6f-901da42881c5', 'a67f6a55-62c8-45f8-8462-32b946bf4b6e', 'bd588ee2-4409-4187-9ed4-2127eebd1afd', '57879928-b294-4b3a-8a0f-78ff27a9dd86'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1fa486db-2af5-4aed-a211-146b5986a23f tempest-GroupSnapshotsTest-1211595780 None] group_snapshot c2da320b-d332-4b4a-9a0c-ba41d1ecce2d: deleted successfully Nov 03 12:56:48 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 1073741824" returned: 0 in 0.666s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:48 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 Nov 03 12:56:48 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:49 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367dc5c7-b25c-4061-98bd-0d088c22114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b694cf7-0d9d-43ad-9751-112225913599', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf745ba7-ce72-4116-8396-c9ee59df7387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Volume volume-7b694cf7-0d9d-43ad-9751-112225913599 (7b694cf7-0d9d-43ad-9751-112225913599): created successfully Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf745ba7-ce72-4116-8396-c9ee59df7387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Flow 'volume_create_manager' (69186fb6-a83d-4c52-bde5-2f6d9d5ca300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-009d37b1-be8f-4161-aab7-5e4dd25d4858 tempest-ServersNegativeTestJSON-450903060 None] Created volume successfully. Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "cinder-quobyte-2841a38b-ae80-41d5-901b-75a61fcfb143" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-2841a38b-ae80-41d5-901b-75a61fcfb143" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e53a2c-f97b-430e-82fc-2ede2a9b4472]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:49 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 Nov 03 12:56:49 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:49 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:50 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143 Nov 03 12:56:50 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:50 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2841a38b-ae80-41d5-901b-75a61fcfb143" returned: 0 in 0.315s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Lock "cinder-quobyte-2841a38b-ae80-41d5-901b-75a61fcfb143" released by "delete_volume" :: held 0.878s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=122,cinder:UPDATE=106,cinder:INSERT=28,cinder:DELETE=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['b0e0cae3-686e-4741-aa45-49238552da80'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:50 devstack cinder-volume[86369]: WARNING cinder.quota [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1675268698 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1675268698, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Created reservations ['99ebb3b1-b789-4b18-aff1-e8e9b8ea9f47', 'efd24802-6b2a-4d9f-8802-c4a839d8b305', '6b7d7cac-d46b-404f-9847-e63473edb820', '26db4393-076e-43b7-a915-84537e1d459d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:50 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:56:50 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:51 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:51 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:56:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-15808dd5-fae7-4cc2-af77-52e2640e2327 tempest-GroupSnapshotsTest-1211595780 None] Delete group completed successfully. Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Flow 'volume_create_manager' (d72cc281-851c-4afe-b7c3-7e1e223b0586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23635cec-5569-4e4f-ab66-a7c14974ab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23635cec-5569-4e4f-ab66-a7c14974ab04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1071294645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c44fb62-5b0f-4761-9423-2933193aaaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f204f39baadd497ea9b3303f1879e031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:56Z,use_quota=True,user_id='f79c6113b97b495fa4fd94f5aea2ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67069b74-1547-4fa3-a9d3-ac92901229bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67069b74-1547-4fa3-a9d3-ac92901229bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5f2c4b-a177-44a3-b349-a0a9f01207ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5f2c4b-a177-44a3-b349-a0a9f01207ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c44fb62-5b0f-4761-9423-2933193aaaf3', 'volume_name': 'volume-0c44fb62-5b0f-4761-9423-2933193aaaf3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8fa43f-7dc8-49ba-82a6-d42f5f5794ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8fa43f-7dc8-49ba-82a6-d42f5f5794ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58971d31-73d7-4b29-9722-9817cf494712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Volume 0c44fb62-5b0f-4761-9423-2933193aaaf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c44fb62-5b0f-4761-9423-2933193aaaf3', 'volume_size': 1} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1071294645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c44fb62-5b0f-4761-9423-2933193aaaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f204f39baadd497ea9b3303f1879e031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:56:56Z,use_quota=True,user_id='f79c6113b97b495fa4fd94f5aea2ffc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Creating volume 0c44fb62-5b0f-4761-9423-2933193aaaf3 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:56:55 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:56:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:55 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 1073741824 Nov 03 12:56:55 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:56 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 1073741824" returned: 0 in 0.515s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:56 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 Nov 03 12:56:56 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:56 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3" returned: 0 in 0.439s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58971d31-73d7-4b29-9722-9817cf494712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c44fb62-5b0f-4761-9423-2933193aaaf3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8323c7d2-48b4-4c7e-8f90-2d0ad5561b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:56:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Volume volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 (0c44fb62-5b0f-4761-9423-2933193aaaf3): created successfully Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8323c7d2-48b4-4c7e-8f90-2d0ad5561b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:56:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Flow 'volume_create_manager' (d72cc281-851c-4afe-b7c3-7e1e223b0586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:56:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fd27e1da-c6ff-4799-b4a9-e9b3e9e9d6b5 tempest-ServersNegativeTestJSON-450903060 None] Created volume successfully. Nov 03 12:56:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:56:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:56:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:56:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:56:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:56:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:56:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:58 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:56:58 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:58 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 8 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "cinder-0c44fb62-5b0f-4761-9423-2933193aaaf3-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-0c44fb62-5b0f-4761-9423-2933193aaaf3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "cinder-quobyte-0c44fb62-5b0f-4761-9423-2933193aaaf3" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-quobyte-0c44fb62-5b0f-4761-9423-2933193aaaf3" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[611395eb-5153-4a93-982b-7b8a1218123d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:56:59 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 Nov 03 12:56:59 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:56:59 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:56:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:00 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3 Nov 03 12:57:00 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:00 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0c44fb62-5b0f-4761-9423-2933193aaaf3" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-quobyte-0c44fb62-5b0f-4761-9423-2933193aaaf3" released by "delete_volume" :: held 0.884s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Created reservations ['f5c21a73-f12a-4190-8902-021f86019c75', '9521f533-e650-46f9-b13b-58480cb6f5f0', 'bda91c85-cd7a-4d1a-8829-a89a672f8f01', 'fe48fbe7-6b21-41e2-80fe-4bca95bb8c31'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "cinder-7b694cf7-0d9d-43ad-9751-112225913599-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:57:00 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:57:00 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-7b694cf7-0d9d-43ad-9751-112225913599-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "cinder-quobyte-7b694cf7-0d9d-43ad-9751-112225913599" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-quobyte-7b694cf7-0d9d-43ad-9751-112225913599" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd43b3-be2e-4dad-8f2a-7c32cff603dc]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:00 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 Nov 03 12:57:00 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:01 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:57:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Deleted volume successfully. Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24cc1f10-a855-41af-8077-9699dc887ed7 tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-0c44fb62-5b0f-4761-9423-2933193aaaf3-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:01 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599" returned: 0 in 0.547s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:01 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599 Nov 03 12:57:01 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:01 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7b694cf7-0d9d-43ad-9751-112225913599" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-quobyte-7b694cf7-0d9d-43ad-9751-112225913599" released by "delete_volume" :: held 0.946s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Created reservations ['89139dc9-888e-4cf8-acdc-c6a188bca478', '74755fb3-3f17-4912-a102-a69f2d4f8450', '30292dbd-37a9-4230-b577-7b5c409de0e0', 'b5bb4f80-2c89-43b3-8c0d-6dc79816c0f7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:01 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:57:01 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:02 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.317s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:02 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:57:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Deleted volume successfully. Nov 03 12:57:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-99256fe9-3c2d-47a2-bde1-49f8c5a1ee1f tempest-ServersNegativeTestJSON-450903060 None] Lock "cinder-7b694cf7-0d9d-43ad-9751-112225913599-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:11 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=65,cinder:INSERT=19,cinder:UPDATE=85,cinder:DELETE=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:57:12 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=21,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:57:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0ba0f247-df29-4152-8624-2f0f908c2c87 tempest-GroupsV314Test-1581512630 None] Group tempest-GroupsV314Test-Group-2081280720: creating Nov 03 12:57:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0ba0f247-df29-4152-8624-2f0f908c2c87 tempest-GroupsV314Test-1581512630 None] Group tempest-GroupsV314Test-Group-2081280720: created successfully Nov 03 12:57:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0ba0f247-df29-4152-8624-2f0f908c2c87 tempest-GroupsV314Test-1581512630 None] Create group completed successfully. Nov 03 12:57:15 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:57:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Flow 'volume_create_manager' (49877351-04ea-45ae-a9aa-04c213e2ff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:57:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a57c3be-ab95-4fb7-961e-eeb0d904283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a57c3be-ab95-4fb7-961e-eeb0d904283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718877389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d63c0c2d-58f1-42fc-9e83-9a23bcc9158c,host='devstack@QuobyteHD#QuobyteHD',id=ef1b1794-7ccd-4f67-bd06-f495d2ad3b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf0226162c3468fa9f3944c8f4c7882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:57:16Z,use_quota=True,user_id='99911d4a1a66446ba088403f6319e9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c20b540-019a-419c-b556-7f4e6d768ed3),volume_type_id=2c20b540-019a-419c-b556-7f4e6d768ed3)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8908a3a-dfba-4ca1-bf65-54481f868d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8908a3a-dfba-4ca1-bf65-54481f868d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9feea62f-0886-44fe-8581-bf2a56f74393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9feea62f-0886-44fe-8581-bf2a56f74393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1b1794-7ccd-4f67-bd06-f495d2ad3b31', 'volume_name': 'volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182b0325-d1d6-4358-b930-32a6bd2cd906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182b0325-d1d6-4358-b930-32a6bd2cd906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a750063a-2970-4855-a193-118e87ea4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Volume ef1b1794-7ccd-4f67-bd06-f495d2ad3b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31', 'volume_size': 1} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d63c0c2d-58f1-42fc-9e83-9a23bcc9158c,created_at=2026-11-03T11:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718877389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d63c0c2d-58f1-42fc-9e83-9a23bcc9158c,host='devstack@QuobyteHD#QuobyteHD',id=ef1b1794-7ccd-4f67-bd06-f495d2ad3b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf0226162c3468fa9f3944c8f4c7882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:57:16Z,use_quota=True,user_id='99911d4a1a66446ba088403f6319e9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c20b540-019a-419c-b556-7f4e6d768ed3),volume_type_id=2c20b540-019a-419c-b556-7f4e6d768ed3)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Creating volume ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:57:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:16 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 1073741824 Nov 03 12:57:16 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:16 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 1073741824" returned: 0 in 0.619s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:16 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 Nov 03 12:57:16 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:17 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" returned: 0 in 0.367s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:57:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a750063a-2970-4855-a193-118e87ea4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e23fb78-afe1-4391-93a7-4507edcffde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Volume volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 (ef1b1794-7ccd-4f67-bd06-f495d2ad3b31): created successfully Nov 03 12:57:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e23fb78-afe1-4391-93a7-4507edcffde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Flow 'volume_create_manager' (49877351-04ea-45ae-a9aa-04c213e2ff17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:57:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2a68b36f-703e-42bf-974d-49f1e8512d3b tempest-GroupsV314Test-1581512630 None] Created volume successfully. Nov 03 12:57:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Cloning volume ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 to volume b99076db-fe48-4478-bec2-c14b63307530 Nov 03 12:57:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Creating offline snapshot 5bbde9ce-d564-48c2-bcf8-bf3978ffea0b of volume ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:57:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf1d03c-a5d9-4507-8628-05ba020aad4d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:20 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 Nov 03 12:57:20 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:21 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" returned: 0 in 0.916s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:21 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b 1G Nov 03 12:57:21 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:22 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b 1G" returned: 0 in 0.887s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:22 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b Nov 03 12:57:22 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:22 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" returned: 0 in 0.682s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:22 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:57:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:22 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b Nov 03 12:57:22 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:23 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" returned: 0 in 0.463s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:23 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.info Nov 03 12:57:23 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:23 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.info" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:57:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:23 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.info Nov 03 12:57:23 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:24 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.info" returned: 0 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Acquiring lock "cinder-quobyte-b99076db-fe48-4478-bec2-c14b63307530" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-b99076db-fe48-4478-bec2-c14b63307530" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] snapshot: 5bbde9ce-d564-48c2-bcf8-bf3978ffea0b, volume: b99076db-fe48-4478-bec2-c14b63307530, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93aa48-27b9-4be4-9703-a4780f6cad88]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:24 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b Nov 03 12:57:24 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:24 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" returned: 0 in 0.534s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b59ff6-a12b-41e8-87dc-389f9bf6a2e2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:25 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 Nov 03 12:57:25 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:25 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 12:57:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 12:57:25 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 12:57:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:25 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 Nov 03 12:57:25 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:33 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:57:33 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:57:35 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530" returned: 0 in 10.019s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31, size 1024.00 MB, duration 10.02 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:57:35 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Converted 1024.00 MB image at 102.20 MB/s Nov 03 12:57:35 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:35 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 Nov 03 12:57:35 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:35 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-b99076db-fe48-4478-bec2-c14b63307530" released by "_copy_volume_from_snapshot" :: held 11.503s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Acquiring lock "cinder-quobyte-5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Deleting offline snapshot 5bbde9ce-d564-48c2-bcf8-bf3978ffea0b of volume ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] snapshot_file for this snap is: volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3908ccd-fb05-4353-a455-1a962bca39f7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Flow 'volume_create_manager' (f7b70de2-3d59-4962-a8ba-233ce1491ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d9566a-e27e-48f3-b39b-0f8186d59c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d9566a-e27e-48f3-b39b-0f8186d59c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-660923840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb49c65-c89a-46dd-8d00-e076ba12c0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2170070f3544823a07869db9323c920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:57:36Z,use_quota=True,user_id='00ba9412c36d4dbd85329591f3232ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d662c4b0-fbe2-4c9c-b7e8-6543134796d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d662c4b0-fbe2-4c9c-b7e8-6543134796d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e9a892-2444-4338-9961-16bec583aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e9a892-2444-4338-9961-16bec583aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb49c65-c89a-46dd-8d00-e076ba12c0f8', 'volume_name': 'volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba773545-980d-44f5-9ba0-f3f190f00fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba773545-980d-44f5-9ba0-f3f190f00fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac07778-c3cc-468f-b6f9-a864ddfc913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Volume 3cb49c65-c89a-46dd-8d00-e076ba12c0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8', 'volume_size': 1} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:36 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b Nov 03 12:57:36 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:36 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" returned: 0 in 0.556s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaaee8d-2a84-415f-853d-9328afd43c55]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:36 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 Nov 03 12:57:36 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:37 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" returned: 0 in 0.567s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:37 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b Nov 03 12:57:37 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:37 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" returned: 0 in 0.429s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:37 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b Nov 03 12:57:37 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:37 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31.5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-5bbde9ce-d564-48c2-bcf8-bf3978ffea0b" released by "_delete_snapshot" :: held 1.975s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.725s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-660923840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb49c65-c89a-46dd-8d00-e076ba12c0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2170070f3544823a07869db9323c920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:57:36Z,use_quota=True,user_id='00ba9412c36d4dbd85329591f3232ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Creating volume 3cb49c65-c89a-46dd-8d00-e076ba12c0f8 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:57:37 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:57:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:37 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 1073741824 Nov 03 12:57:37 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3b8f7831-b4eb-482b-b386-32350d9533b7 tempest-GroupsV314Test-1581512630 None] Create group from source-group-d63c0c2d-58f1-42fc-9e83-9a23bcc9158c completed successfully. Nov 03 12:57:38 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 1073741824" returned: 0 in 0.564s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:38 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 Nov 03 12:57:38 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:38 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac07778-c3cc-468f-b6f9-a864ddfc913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9ed0c3-cd52-4e3e-a3ad-1b44f87d5491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Volume volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 (3cb49c65-c89a-46dd-8d00-e076ba12c0f8): created successfully Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9ed0c3-cd52-4e3e-a3ad-1b44f87d5491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Flow 'volume_create_manager' (f7b70de2-3d59-4962-a8ba-233ce1491ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:57:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a4119df0-22f8-4519-9808-89bae66bed26 tempest-ServerActionsTestOtherA-1693733663 None] Created volume successfully. Nov 03 12:57:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Acquiring lock "cinder-quobyte-b99076db-fe48-4478-bec2-c14b63307530" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:57:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-b99076db-fe48-4478-bec2-c14b63307530" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:57:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[525e55cc-ec11-47d4-8375-1f4f33832c9e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:39 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 Nov 03 12:57:39 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:39 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:39 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530 Nov 03 12:57:39 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:40 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b99076db-fe48-4478-bec2-c14b63307530" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-b99076db-fe48-4478-bec2-c14b63307530" released by "delete_volume" :: held 0.826s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Created reservations ['fc6ae399-de6e-4439-b296-0cdd5780a7df'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:57:40 devstack cinder-volume[86369]: WARNING cinder.quota [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-520283090 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-520283090, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:57:40 devstack cinder-volume[86369]: WARNING cinder.quota [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-520283090 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-520283090, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Created reservations ['4441ecb7-7a67-4095-88dc-8bf53dadc6cc', '002f76ba-f76a-493d-b604-d6213dc41326', 'de30ba46-d80a-44d1-99ec-84f6cc7e3663', 'cb30fd99-91b7-4185-943a-26bd6ca54a71'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:40 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:57:40 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:40 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:57:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-40723bcf-3d96-46ed-98b0-eba011d9201c tempest-GroupsV314Test-1581512630 None] Delete group completed successfully. Nov 03 12:57:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Acquiring lock "cinder-quobyte-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:57:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:57:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d62693-a870-4370-8f7f-66b01f55fddb]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:57:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:41 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 Nov 03 12:57:41 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:41 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" returned: 0 in 0.490s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:41 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31 Nov 03 12:57:41 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:42 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Lock "cinder-quobyte-ef1b1794-7ccd-4f67-bd06-f495d2ad3b31" released by "delete_volume" :: held 0.898s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Created reservations ['b497615a-04d0-4a1f-8967-5b54fabfc63a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Created reservations ['1a0cf87b-2759-46df-bdd7-00946eb3fe1c', '1912d192-c3b5-42f4-9540-dafcd85cc6d0', '23023f62-d741-4609-8467-980a03becd11', 'afde5bce-bc02-4570-a54c-6e3a95eb97ac'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:42 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:57:42 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:42 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:57:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9e6c6dc9-4354-4090-a3c0-f312ac217886 tempest-GroupsV314Test-1581512630 None] Delete group completed successfully. Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Flow 'volume_create_manager' (77c66b69-f455-44c3-9c5a-abbed6be7763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b2f7bf-b056-4a16-9b5f-371702b58a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b2f7bf-b056-4a16-9b5f-371702b58a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1115096071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d2b07f-5042-40e1-8420-9b815952a45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4fa18b56c048b6934b4b24377a2c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:57:47Z,use_quota=True,user_id='1d4fd97b0ef340ecaafe8f1d75bf79eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92adb582-096f-4311-bf1f-111552ff187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92adb582-096f-4311-bf1f-111552ff187d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05094ca5-1eb9-4ee8-bb24-e6cd5a685d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05094ca5-1eb9-4ee8-bb24-e6cd5a685d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d2b07f-5042-40e1-8420-9b815952a45b', 'volume_name': 'volume-48d2b07f-5042-40e1-8420-9b815952a45b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5974c58f-734c-450c-b9a4-5a6e4a46a2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5974c58f-734c-450c-b9a4-5a6e4a46a2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df84ca-9600-4dad-ac3f-42416d13c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Volume 48d2b07f-5042-40e1-8420-9b815952a45b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d2b07f-5042-40e1-8420-9b815952a45b', 'volume_size': 1} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1115096071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d2b07f-5042-40e1-8420-9b815952a45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4fa18b56c048b6934b4b24377a2c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:57:47Z,use_quota=True,user_id='1d4fd97b0ef340ecaafe8f1d75bf79eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Creating volume 48d2b07f-5042-40e1-8420-9b815952a45b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:57:47 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:57:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:47 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b 1073741824 Nov 03 12:57:47 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:48 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b 1073741824" returned: 0 in 0.794s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:48 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b Nov 03 12:57:48 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:48 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df84ca-9600-4dad-ac3f-42416d13c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d2b07f-5042-40e1-8420-9b815952a45b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5636a5fb-2185-411f-8517-0123ba4b0ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:57:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Volume volume-48d2b07f-5042-40e1-8420-9b815952a45b (48d2b07f-5042-40e1-8420-9b815952a45b): created successfully Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5636a5fb-2185-411f-8517-0123ba4b0ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:57:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Flow 'volume_create_manager' (77c66b69-f455-44c3-9c5a-abbed6be7763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:57:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1ae6f203-c460-4edf-bd54-57f60504a8a2 tempest-AttachVolumeShelveTestJSON-1687869161 None] Created volume successfully. Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=28,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:57:58 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:57:58 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=19,cinder:UPDATE=34,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:57:58 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:57:59 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Nov 03 12:57:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.978s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:57:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:57:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:57:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 8 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:57:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:58:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-211165ad-42e7-4d73-954d-5e5dce750853 req-506a9efc-9de2-4d81-b57c-20bfb9090cdc tempest-AttachVolumeShelveTestJSON-1687869161 None] No connector for attachment 52df2161-4fee-4194-b506-a77533f0bb14; skipping storage backend terminate_connection call. {{(pid=86369) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 12:58:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-211165ad-42e7-4d73-954d-5e5dce750853 req-506a9efc-9de2-4d81-b57c-20bfb9090cdc tempest-AttachVolumeShelveTestJSON-1687869161 None] Deleting attachment 52df2161-4fee-4194-b506-a77533f0bb14. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Flow 'volume_create_manager' (005d0748-9af3-41be-8b29-e6174286a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1429968a-9684-4e6d-8ee1-a73dc4114032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1429968a-9684-4e6d-8ee1-a73dc4114032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1099495826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4348c1-14b0-4674-b5ee-3eda1649a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae30043614c47fb9c2b0976331d8e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:06Z,use_quota=True,user_id='55f35cdbd8a34c21a12a896420d2484e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49e1f3d-7181-4d77-9f9d-a152980127c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49e1f3d-7181-4d77-9f9d-a152980127c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2097b0ca-c07b-4f2f-9db5-60c0129e2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2097b0ca-c07b-4f2f-9db5-60c0129e2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4348c1-14b0-4674-b5ee-3eda1649a96f', 'volume_name': 'volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2b3099-acff-447a-bde1-605784f738aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2b3099-acff-447a-bde1-605784f738aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15bf92b-1fd7-48ab-b746-e1244af05067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Volume 2a4348c1-14b0-4674-b5ee-3eda1649a96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f', 'volume_size': 1} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1099495826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4348c1-14b0-4674-b5ee-3eda1649a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae30043614c47fb9c2b0976331d8e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:06Z,use_quota=True,user_id='55f35cdbd8a34c21a12a896420d2484e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Creating volume 2a4348c1-14b0-4674-b5ee-3eda1649a96f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:58:06 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:06 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f 1073741824 Nov 03 12:58:06 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:06 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f 1073741824" returned: 0 in 0.491s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:06 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f Nov 03 12:58:06 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:06 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:58:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15bf92b-1fd7-48ab-b746-e1244af05067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ea9204-6ec6-4a62-8a19-a2b8195cfde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Volume volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f (2a4348c1-14b0-4674-b5ee-3eda1649a96f): created successfully Nov 03 12:58:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ea9204-6ec6-4a62-8a19-a2b8195cfde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Flow 'volume_create_manager' (005d0748-9af3-41be-8b29-e6174286a97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f4f3b55c-5a06-4df0-9151-43c3a50798f9 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Created volume successfully. Nov 03 12:58:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Acquiring lock "cinder-2a4348c1-14b0-4674-b5ee-3eda1649a96f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "cinder-2a4348c1-14b0-4674-b5ee-3eda1649a96f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Acquiring lock "cinder-quobyte-2a4348c1-14b0-4674-b5ee-3eda1649a96f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "cinder-quobyte-2a4348c1-14b0-4674-b5ee-3eda1649a96f" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[44255ddb-a2a7-4f2a-9fb4-e0e4225923d6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:09 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f Nov 03 12:58:09 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:10 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f" returned: 0 in 0.498s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:10 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f Nov 03 12:58:10 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:10 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a4348c1-14b0-4674-b5ee-3eda1649a96f" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "cinder-quobyte-2a4348c1-14b0-4674-b5ee-3eda1649a96f" released by "delete_volume" :: held 0.908s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Created reservations ['a62af2a8-1a19-47ab-b2d1-e28983d085c2', '1d5e551b-d782-448a-a53c-aa0e06d3663f', '5733671c-12d8-4b28-a05f-ad6203dabaf0', 'b3c0c768-dcbc-40aa-b4cf-b4f8bffb8c2b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:10 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:10 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:11 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:11 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Deleted volume successfully. Nov 03 12:58:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95e2c56b-8548-4e60-bfaf-2107b1277fa4 tempest-VolumeQuotasNegativeTestJSON-1772021732 None] Lock "cinder-2a4348c1-14b0-4674-b5ee-3eda1649a96f-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Flow 'volume_create_manager' (17aab64d-a9cf-4715-8178-f4ebaf05ce4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c908e9-1583-4896-8213-807fdbf8e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c908e9-1583-4896-8213-807fdbf8e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1801397319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9eccc3-55d6-4f02-8535-3b5dadaa206a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781e3a418ab64f2a8d92a0f5fbe2400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:18Z,use_quota=True,user_id='e1925633abe447d2ac2618a86fe1b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d5b55a-c7aa-45a5-a913-46b869076039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d5b55a-c7aa-45a5-a913-46b869076039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88630b76-6842-492c-a628-2c6813e6c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88630b76-6842-492c-a628-2c6813e6c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9eccc3-55d6-4f02-8535-3b5dadaa206a', 'volume_name': 'volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7989b5a3-ef9a-4cf6-af37-12a55623060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7989b5a3-ef9a-4cf6-af37-12a55623060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a3c105-1de5-4d17-9dfe-bf5460401fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Volume 7e9eccc3-55d6-4f02-8535-3b5dadaa206a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a', 'volume_size': 1} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1801397319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9eccc3-55d6-4f02-8535-3b5dadaa206a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781e3a418ab64f2a8d92a0f5fbe2400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:18Z,use_quota=True,user_id='e1925633abe447d2ac2618a86fe1b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Creating volume 7e9eccc3-55d6-4f02-8535-3b5dadaa206a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:58:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:58:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:17 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a 1073741824 Nov 03 12:58:17 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:18 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a 1073741824" returned: 0 in 0.813s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:18 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a Nov 03 12:58:18 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:19 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a3c105-1de5-4d17-9dfe-bf5460401fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e74417-387c-4a4d-ac91-331471fadbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Volume volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a (7e9eccc3-55d6-4f02-8535-3b5dadaa206a): created successfully Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e74417-387c-4a4d-ac91-331471fadbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Flow 'volume_create_manager' (17aab64d-a9cf-4715-8178-f4ebaf05ce4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Flow 'volume_create_manager' (0355a99d-35f2-48cb-800e-d45da04e81ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f130256-048d-4ffe-ae17-08c17cc0d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fc5b4bdf-fdf3-47a4-bdf1-220c01d590e1 tempest-AttachVolumeTestJSON-1648937044 None] Created volume successfully. Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f130256-048d-4ffe-ae17-08c17cc0d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-251839645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63215d3c-ee9b-460f-b21b-7530440dc61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409e37dc42e4c47aa2b64aaa8fb166f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:19Z,use_quota=True,user_id='40c69e8137604c039e9aff0caa9a87aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ee9e7b2-a407-4628-a009-d485924d917d),volume_type_id=1ee9e7b2-a407-4628-a009-d485924d917d)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f291836-1a74-46a9-bfca-c26445843615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f291836-1a74-46a9-bfca-c26445843615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7268e0f-692a-49e0-ad55-4c75c7e8958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7268e0f-692a-49e0-ad55-4c75c7e8958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63215d3c-ee9b-460f-b21b-7530440dc61a', 'volume_name': 'volume-63215d3c-ee9b-460f-b21b-7530440dc61a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdc2393-b1b7-46a6-8f38-1500628da48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdc2393-b1b7-46a6-8f38-1500628da48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77011d23-58d0-417c-9711-b5368cbb1855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Volume 63215d3c-ee9b-460f-b21b-7530440dc61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63215d3c-ee9b-460f-b21b-7530440dc61a', 'volume_size': 1} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-251839645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63215d3c-ee9b-460f-b21b-7530440dc61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5409e37dc42e4c47aa2b64aaa8fb166f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:19Z,use_quota=True,user_id='40c69e8137604c039e9aff0caa9a87aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ee9e7b2-a407-4628-a009-d485924d917d),volume_type_id=1ee9e7b2-a407-4628-a009-d485924d917d)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Creating volume 63215d3c-ee9b-460f-b21b-7530440dc61a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:58:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:19 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a 1073741824 Nov 03 12:58:19 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1c92d4da-efb8-4e76-afa7-d4c1bba91abd req-d87d4c0a-7e32-4447-bbd3-612b386faab6 tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:19 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a 1073741824" returned: 0 in 0.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:19 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a Nov 03 12:58:19 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:20 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1c92d4da-efb8-4e76-afa7-d4c1bba91abd req-d87d4c0a-7e32-4447-bbd3-612b386faab6 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.723s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77011d23-58d0-417c-9711-b5368cbb1855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63215d3c-ee9b-460f-b21b-7530440dc61a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa9b6ed-a7d7-45b9-9512-06a87f95c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1c92d4da-efb8-4e76-afa7-d4c1bba91abd req-d87d4c0a-7e32-4447-bbd3-612b386faab6 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Volume volume-63215d3c-ee9b-460f-b21b-7530440dc61a (63215d3c-ee9b-460f-b21b-7530440dc61a): created successfully Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa9b6ed-a7d7-45b9-9512-06a87f95c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Flow 'volume_create_manager' (0355a99d-35f2-48cb-800e-d45da04e81ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ae1c05c8-3d98-41dd-9d43-651debe125f1 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Created volume successfully. Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-1c92d4da-efb8-4e76-afa7-d4c1bba91abd req-d87d4c0a-7e32-4447-bbd3-612b386faab6 tempest-ServerActionsTestOtherA-1693733663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb62e618-021a-4da5-a0e4-8e125b9bf82c', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:58:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-1c92d4da-efb8-4e76-afa7-d4c1bba91abd req-d87d4c0a-7e32-4447-bbd3-612b386faab6 tempest-ServerActionsTestOtherA-1693733663 None] attachment_update completed successfully. Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-8e27e257-9976-4671-9472-a434c77fb81d req-aea4392a-790f-41ea-98a2-1e2eae616c3e tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-8e27e257-9976-4671-9472-a434c77fb81d req-aea4392a-790f-41ea-98a2-1e2eae616c3e tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-8e27e257-9976-4671-9472-a434c77fb81d req-aea4392a-790f-41ea-98a2-1e2eae616c3e tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-8e27e257-9976-4671-9472-a434c77fb81d req-aea4392a-790f-41ea-98a2-1e2eae616c3e tempest-AttachVolumeTestJSON-1648937044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '370c9878-8ea7-407a-b535-6db214d46615', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:58:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-8e27e257-9976-4671-9472-a434c77fb81d req-aea4392a-790f-41ea-98a2-1e2eae616c3e tempest-AttachVolumeTestJSON-1648937044 None] attachment_update completed successfully. Nov 03 12:58:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:21 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:21 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:22 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:22 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b3d5bedb-175a-4643-88a0-80d0dde08763 tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Retype volume completed successfully. Nov 03 12:58:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Acquiring lock "cinder-63215d3c-ee9b-460f-b21b-7530440dc61a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "cinder-63215d3c-ee9b-460f-b21b-7530440dc61a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Acquiring lock "cinder-quobyte-63215d3c-ee9b-460f-b21b-7530440dc61a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "cinder-quobyte-63215d3c-ee9b-460f-b21b-7530440dc61a" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b113b5ab-868c-4850-85ce-cf377f86d5f2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:23 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a Nov 03 12:58:23 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:24 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a" returned: 0 in 0.565s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:24 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a Nov 03 12:58:24 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-1be4a246-e83e-4e5d-93a6-e3048bd083d6 req-b0ee34c6-5bee-43f5-a1e2-1f626b98a533 tempest-ServerActionsTestOtherA-1693733663 None] Terminate volume connection completed successfully. Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-1be4a246-e83e-4e5d-93a6-e3048bd083d6 req-b0ee34c6-5bee-43f5-a1e2-1f626b98a533 tempest-ServerActionsTestOtherA-1693733663 None] Deleting attachment fb62e618-021a-4da5-a0e4-8e125b9bf82c. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:58:24 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-63215d3c-ee9b-460f-b21b-7530440dc61a" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "cinder-quobyte-63215d3c-ee9b-460f-b21b-7530440dc61a" released by "delete_volume" :: held 1.036s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:24 devstack cinder-volume[86369]: WARNING cinder.quota [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:58:24 devstack cinder-volume[86369]: WARNING cinder.quota [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Created reservations ['717cbc81-429d-458c-b663-37dd5f008ec7', 'c502fd8f-0b00-409c-b789-00d192f9c182', '0f8fae94-15e8-43ec-9709-344b7ff21f77', '66ccac47-b79f-4802-b7c0-24342e258063'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:24 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:24 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:25 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.615s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:25 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Deleted volume successfully. Nov 03 12:58:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-afbe5a54-f07e-44c5-bb63-2b26488cccba tempest-VolumeRetypeWithoutMigrationTest-959592791 None] Lock "cinder-63215d3c-ee9b-460f-b21b-7530440dc61a-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1be4a246-e83e-4e5d-93a6-e3048bd083d6 req-8a1d3262-fc80-4ab2-a05d-87e89b12d913 tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1be4a246-e83e-4e5d-93a6-e3048bd083d6 req-8a1d3262-fc80-4ab2-a05d-87e89b12d913 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1be4a246-e83e-4e5d-93a6-e3048bd083d6 req-8a1d3262-fc80-4ab2-a05d-87e89b12d913 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-1be4a246-e83e-4e5d-93a6-e3048bd083d6 req-8a1d3262-fc80-4ab2-a05d-87e89b12d913 tempest-ServerActionsTestOtherA-1693733663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dadadc6-25de-47d1-b4fb-2c435c76cfa7', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:58:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-1be4a246-e83e-4e5d-93a6-e3048bd083d6 req-8a1d3262-fc80-4ab2-a05d-87e89b12d913 tempest-ServerActionsTestOtherA-1693733663 None] attachment_update completed successfully. Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=44,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=45,cinder:UPDATE=32,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Flow 'volume_create_manager' (87e21a10-fa45-44ad-b744-499865c744fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a28ad0-7866-43ac-b643-3ed468bf114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a28ad0-7866-43ac-b643-3ed468bf114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-995381112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e675ffcb-c7d9-4615-a8cf-155db1773820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52cc5e70540745adb9618b22f8774257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:36Z,use_quota=True,user_id='3994bb2003ce4072b6c685ed16f993fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0359c94e-8087-4cef-bbb2-4af0735931b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0359c94e-8087-4cef-bbb2-4af0735931b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fd9879-edc9-4afd-84fc-fd64a256a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fd9879-edc9-4afd-84fc-fd64a256a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e675ffcb-c7d9-4615-a8cf-155db1773820', 'volume_name': 'volume-e675ffcb-c7d9-4615-a8cf-155db1773820', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad753855-080d-43e0-b84c-359ead70de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad753855-080d-43e0-b84c-359ead70de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d630410-39d7-492f-97e7-3aa486ec1ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Volume e675ffcb-c7d9-4615-a8cf-155db1773820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e675ffcb-c7d9-4615-a8cf-155db1773820', 'volume_size': 1} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-995381112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e675ffcb-c7d9-4615-a8cf-155db1773820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52cc5e70540745adb9618b22f8774257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:36Z,use_quota=True,user_id='3994bb2003ce4072b6c685ed16f993fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Creating volume e675ffcb-c7d9-4615-a8cf-155db1773820 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:58:36 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:58:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:36 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 1073741824 Nov 03 12:58:36 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:37 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 1073741824" returned: 0 in 0.845s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:37 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 Nov 03 12:58:37 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:37 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d630410-39d7-492f-97e7-3aa486ec1ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e675ffcb-c7d9-4615-a8cf-155db1773820', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5352eeb4-52c8-4912-8c14-a3baa219d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Volume volume-e675ffcb-c7d9-4615-a8cf-155db1773820 (e675ffcb-c7d9-4615-a8cf-155db1773820): created successfully Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5352eeb4-52c8-4912-8c14-a3baa219d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Flow 'volume_create_manager' (87e21a10-fa45-44ad-b744-499865c744fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-025c1d25-b8d2-498b-853a-5083f2ab6328 tempest-VolumesServicesTestJSON-1112808149 None] Created volume successfully. Nov 03 12:58:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Acquiring lock "cinder-e675ffcb-c7d9-4615-a8cf-155db1773820-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Lock "cinder-e675ffcb-c7d9-4615-a8cf-155db1773820-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Acquiring lock "cinder-quobyte-e675ffcb-c7d9-4615-a8cf-155db1773820" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Lock "cinder-quobyte-e675ffcb-c7d9-4615-a8cf-155db1773820" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66a0c56-94a0-4583-9489-a845fea9b985]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:38 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 Nov 03 12:58:38 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820" returned: 0 in 0.690s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:39 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:39 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820 Nov 03 12:58:39 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:39 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e675ffcb-c7d9-4615-a8cf-155db1773820" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Lock "cinder-quobyte-e675ffcb-c7d9-4615-a8cf-155db1773820" released by "delete_volume" :: held 1.265s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Created reservations ['656d4bb2-158b-432f-aa5b-98477b9ba567', '811ec8e2-b87a-474e-969d-d5170e698c51', '43dfc61a-385b-4877-86c9-4316aa83aa98', '31a7fc16-3ccd-4c3c-81b0-c37f84896840'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:40 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:40 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:40 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.546s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Deleted volume successfully. Nov 03 12:58:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea17ed3e-0f2c-436b-a5d1-601d3022a392 tempest-VolumesServicesTestJSON-1112808149 None] Lock "cinder-e675ffcb-c7d9-4615-a8cf-155db1773820-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Acquiring lock "cinder-48d2b07f-5042-40e1-8420-9b815952a45b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "cinder-48d2b07f-5042-40e1-8420-9b815952a45b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Acquiring lock "cinder-quobyte-48d2b07f-5042-40e1-8420-9b815952a45b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "cinder-quobyte-48d2b07f-5042-40e1-8420-9b815952a45b" acquired by "delete_volume" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b16c8-940b-434f-9edb-1f65883f2a96]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:44 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b Nov 03 12:58:44 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:45 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:45 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b Nov 03 12:58:45 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:45 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-48d2b07f-5042-40e1-8420-9b815952a45b" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "cinder-quobyte-48d2b07f-5042-40e1-8420-9b815952a45b" released by "delete_volume" :: held 0.996s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Created reservations ['7cf4e633-d7ab-4388-ac8b-20a60c8914cd', 'af52436f-12f1-4918-84e9-a2bebe34e6bf', 'd5831074-0bdb-413c-820c-6fe917191e51', '6e34225f-e233-4dc5-9fba-0c1611626d59'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:45 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:45 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:46 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:46 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Deleted volume successfully. Nov 03 12:58:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a57308ee-57f1-4120-ba30-83c28ccaa342 tempest-AttachVolumeShelveTestJSON-1687869161 None] Lock "cinder-48d2b07f-5042-40e1-8420-9b815952a45b-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Flow 'volume_create_manager' (12fb50e4-0408-4bae-8d8b-b0cdc02155d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c15839-1ed7-4e1e-9353-de1393f2c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c15839-1ed7-4e1e-9353-de1393f2c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-702327857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a563179f-2152-41ee-81f7-c49c1941cca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5351eda99de4c14857a52b5f15ef184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:49Z,use_quota=True,user_id='fa8c6ca1146b403ca0e6b4f72ec6384d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41027db-07c9-4870-ba37-13c1e4bfeec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41027db-07c9-4870-ba37-13c1e4bfeec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a64939e-bdeb-42aa-8418-d6aa4e4f13b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a64939e-bdeb-42aa-8418-d6aa4e4f13b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a563179f-2152-41ee-81f7-c49c1941cca3', 'volume_name': 'volume-a563179f-2152-41ee-81f7-c49c1941cca3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef82bd06-9889-48ac-8ec9-58a3b0879203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef82bd06-9889-48ac-8ec9-58a3b0879203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56995da3-9143-4518-a2fb-b1b5f6d67a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Volume a563179f-2152-41ee-81f7-c49c1941cca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a563179f-2152-41ee-81f7-c49c1941cca3', 'volume_size': 1} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-702327857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a563179f-2152-41ee-81f7-c49c1941cca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5351eda99de4c14857a52b5f15ef184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:49Z,use_quota=True,user_id='fa8c6ca1146b403ca0e6b4f72ec6384d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Creating volume a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:58:49 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:49 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 1073741824 Nov 03 12:58:49 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:49 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 1073741824" returned: 0 in 0.455s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:49 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 Nov 03 12:58:49 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:49 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3" returned: 0 in 0.241s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56995da3-9143-4518-a2fb-b1b5f6d67a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a563179f-2152-41ee-81f7-c49c1941cca3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d5e350-760c-46de-8f69-23997f45b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Volume volume-a563179f-2152-41ee-81f7-c49c1941cca3 (a563179f-2152-41ee-81f7-c49c1941cca3): created successfully Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d5e350-760c-46de-8f69-23997f45b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Flow 'volume_create_manager' (12fb50e4-0408-4bae-8d8b-b0cdc02155d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9f142862-1649-48f6-80b9-f8f49a55ea2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Created volume successfully. Nov 03 12:58:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Creating offline snapshot f21d3058-98ef-40a1-a144-7db9ea64ed0a of volume a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 12:58:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cfc076-5709-4a28-a919-2818b3a078fd]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:50 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 Nov 03 12:58:50 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:50 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3" returned: 0 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:50 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a 1G Nov 03 12:58:50 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:51 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a 1G" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a563179f-2152-41ee-81f7-c49c1941cca3 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:51 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a563179f-2152-41ee-81f7-c49c1941cca3 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a Nov 03 12:58:51 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:51 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a563179f-2152-41ee-81f7-c49c1941cca3 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a" returned: 0 in 0.297s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:51 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a is being set with open permissions: ugo+rw Nov 03 12:58:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:51 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a Nov 03 12:58:51 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:51 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:51 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.info Nov 03 12:58:51 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:52 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.info" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:52 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.info is being set with open permissions: ugo+rw Nov 03 12:58:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:52 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.info Nov 03 12:58:52 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:52 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.info" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d2736f58-2f5f-426b-91ed-e24928066579 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Create snapshot completed successfully Nov 03 12:58:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "cinder-f21d3058-98ef-40a1-a144-7db9ea64ed0a-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-f21d3058-98ef-40a1-a144-7db9ea64ed0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "cinder-quobyte-a563179f-2152-41ee-81f7-c49c1941cca3" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-quobyte-a563179f-2152-41ee-81f7-c49c1941cca3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "cinder-quobyte-f21d3058-98ef-40a1-a144-7db9ea64ed0a" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-quobyte-f21d3058-98ef-40a1-a144-7db9ea64ed0a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Deleting offline snapshot f21d3058-98ef-40a1-a144-7db9ea64ed0a of volume a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] snapshot_file for this snap is: volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c5b3f9-8228-42c5-a884-7ed4a3d1d38a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:54 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a Nov 03 12:58:54 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:54 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a563179f-2152-41ee-81f7-c49c1941cca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd5d6ca-20df-4f51-a794-485f0f21a4a2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Flow 'volume_create_manager' (1a932140-8298-4aa1-b12c-8dd2ce05e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:54 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 Nov 03 12:58:54 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60ec6c9-f0d6-4072-b531-28c9a40cf44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60ec6c9-f0d6-4072-b531-28c9a40cf44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-958889119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640675b7-bd04-4f38-9987-697444452cf1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='846385602d8f41aba7087bf0042fa969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:55Z,use_quota=True,user_id='326fda10c19248ef98efddc29fd201f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c975ee-6c5b-4ce0-bb95-37f9b9858219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c975ee-6c5b-4ce0-bb95-37f9b9858219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14e1cc5-73cb-44a2-a6cf-99daf9062ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14e1cc5-73cb-44a2-a6cf-99daf9062ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640675b7-bd04-4f38-9987-697444452cf1', 'volume_name': 'volume-640675b7-bd04-4f38-9987-697444452cf1', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5703ae8-b10f-4d91-9fac-1b35541a353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5703ae8-b10f-4d91-9fac-1b35541a353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6ad07a-629d-47f7-b0d8-857d9762485b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Volume 640675b7-bd04-4f38-9987-697444452cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640675b7-bd04-4f38-9987-697444452cf1', 'volume_size': 1} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-958889119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640675b7-bd04-4f38-9987-697444452cf1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='846385602d8f41aba7087bf0042fa969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:58:55Z,use_quota=True,user_id='326fda10c19248ef98efddc29fd201f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Creating volume 640675b7-bd04-4f38-9987-697444452cf1 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:58:54 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:54 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 1073741824 Nov 03 12:58:54 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:54 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:54 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a Nov 03 12:58:54 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:55 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 1073741824" returned: 0 in 0.493s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:55 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 Nov 03 12:58:55 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:55 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:55 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a Nov 03 12:58:55 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:55 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6ad07a-629d-47f7-b0d8-857d9762485b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640675b7-bd04-4f38-9987-697444452cf1', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f78ed2-1bdf-4018-9c74-1f00c59e1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:58:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Volume volume-640675b7-bd04-4f38-9987-697444452cf1 (640675b7-bd04-4f38-9987-697444452cf1): created successfully Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f78ed2-1bdf-4018-9c74-1f00c59e1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:58:55 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Flow 'volume_create_manager' (1a932140-8298-4aa1-b12c-8dd2ce05e06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3.f21d3058-98ef-40a1-a144-7db9ea64ed0a" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-0346476b-422d-4f99-ae85-5417e07439c2 req-092ebf0c-5c0c-4088-8866-32bf571fdeb6 tempest-VolumesGetTestJSON-867792768 None] Created volume successfully. Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-quobyte-f21d3058-98ef-40a1-a144-7db9ea64ed0a" released by "_delete_snapshot" :: held 1.697s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-quobyte-a563179f-2152-41ee-81f7-c49c1941cca3" released by "delete_snapshot" :: held 1.730s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:55 devstack cinder-volume[86369]: WARNING cinder.quota [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Created reservations ['df088a89-d052-4d9b-b72a-629a4c3cd8e3', '781e0162-8816-4c8b-9310-2affebb40f4c', '04be0e88-ce65-4b54-a99f-4a7c04ffa218', '8c594691-e073-4a8c-8b53-7e3e7709c736'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:58:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Delete snapshot completed successfully. Nov 03 12:58:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c177f6ee-74ec-4cb9-979a-0fecbb7a3f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-f21d3058-98ef-40a1-a144-7db9ea64ed0a-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Acquiring lock "cinder-640675b7-bd04-4f38-9987-697444452cf1-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Lock "cinder-640675b7-bd04-4f38-9987-697444452cf1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Acquiring lock "cinder-quobyte-640675b7-bd04-4f38-9987-697444452cf1" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Lock "cinder-quobyte-640675b7-bd04-4f38-9987-697444452cf1" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd4940f-9ae8-4ce7-baef-5280acfe50b3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "cinder-a563179f-2152-41ee-81f7-c49c1941cca3-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-a563179f-2152-41ee-81f7-c49c1941cca3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-d8587ec8-faa7-4675-b0f8-d6674ff2003f req-317b36d5-ecc3-4084-9f3d-efe0cfd0fc4b tempest-ServerActionsTestOtherA-1693733663 None] Terminate volume connection completed successfully. Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-d8587ec8-faa7-4675-b0f8-d6674ff2003f req-317b36d5-ecc3-4084-9f3d-efe0cfd0fc4b tempest-ServerActionsTestOtherA-1693733663 None] Deleting attachment 1dadadc6-25de-47d1-b4fb-2c435c76cfa7. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "cinder-quobyte-a563179f-2152-41ee-81f7-c49c1941cca3" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:58:56 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 Nov 03 12:58:56 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-quobyte-a563179f-2152-41ee-81f7-c49c1941cca3" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65891cd-1d16-44e4-9f84-d62f98d70a88]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:56 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 Nov 03 12:58:56 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:56 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:56 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1 Nov 03 12:58:56 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:56 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3" returned: 0 in 0.407s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:56 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3 Nov 03 12:58:56 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-2c22d3c4-8289-444b-bf22-6895f2b21058 req-4febfbb5-5332-46bc-af1f-aec4e450a126 tempest-AttachVolumeTestJSON-1648937044 None] Terminate volume connection completed successfully. Nov 03 12:58:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-2c22d3c4-8289-444b-bf22-6895f2b21058 req-4febfbb5-5332-46bc-af1f-aec4e450a126 tempest-AttachVolumeTestJSON-1648937044 None] Deleting attachment 370c9878-8ea7-407a-b535-6db214d46615. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:58:57 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-640675b7-bd04-4f38-9987-697444452cf1" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Lock "cinder-quobyte-640675b7-bd04-4f38-9987-697444452cf1" released by "delete_volume" :: held 0.937s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:57 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.quota [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Created reservations ['85a36c8a-113c-420d-a0ca-dd4cd3e4643f', '53fec158-d5c4-43fb-b4c1-7e4b77446669', '9cea6d4c-702b-4bef-94ec-350cd0b8673b', '1933d5df-07eb-48cb-b385-b5c8d854cdfe'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a563179f-2152-41ee-81f7-c49c1941cca3" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-quobyte-a563179f-2152-41ee-81f7-c49c1941cca3" released by "delete_volume" :: held 0.853s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Created reservations ['ff10f2a2-eeef-4567-801b-5cf122ed73fc', '4e2f7619-75a4-4566-832d-ba1ae37cfc5d', '5a13a6ed-27a1-492d-acb3-f87ae8a9b639', 'eb2cbc50-67c0-49b7-895a-6d020f2adfac'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:58:57 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:57 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:57 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:57 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:57 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.517s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.manager [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Deleted volume successfully. Nov 03 12:58:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-5f1b1b6a-50f4-416c-a046-ad5a67d8a569 req-5006e341-7f2c-48d1-adce-8cc8eca62802 tempest-VolumesGetTestJSON-867792768 None] Lock "cinder-640675b7-bd04-4f38-9987-697444452cf1-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:58 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.556s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Deleted volume successfully. Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a138bd0a-7676-4db6-a0b9-4dd874dbcf95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1231320303 None] Lock "cinder-a563179f-2152-41ee-81f7-c49c1941cca3-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:58:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:58:58 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:58:58 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:58:59 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Nov 03 12:58:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.332s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:58:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:58:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:58:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 8 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:58:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Flow 'volume_create_manager' (f91bed38-b885-405c-9aeb-3941ec119e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c408a48-af95-47f7-8c04-1ec1dc2830a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c408a48-af95-47f7-8c04-1ec1dc2830a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1759898722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0552c7d6-3450-4a0a-b093-ebd91165ef36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2170070f3544823a07869db9323c920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:06Z,use_quota=True,user_id='00ba9412c36d4dbd85329591f3232ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da349b6-88ce-4e0c-80b7-bcb9d91b0a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da349b6-88ce-4e0c-80b7-bcb9d91b0a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4f9073-12ba-4b7e-af34-7353895ef45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:06 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4f9073-12ba-4b7e-af34-7353895ef45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0552c7d6-3450-4a0a-b093-ebd91165ef36', 'volume_name': 'volume-0552c7d6-3450-4a0a-b093-ebd91165ef36', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c07c7ec-b92a-45e9-82f9-3f627cd10e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c07c7ec-b92a-45e9-82f9-3f627cd10e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6778c913-f94b-4027-b51b-0e48e59429e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Volume 0552c7d6-3450-4a0a-b093-ebd91165ef36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0552c7d6-3450-4a0a-b093-ebd91165ef36', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Trying to clone 0552c7d6-3450-4a0a-b093-ebd91165ef36 from image 68321eb5-d635-47b3-850b-90ed52040d26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 12:59:07 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Image download 20.69 MB at 20.69 MB/s Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2a39e2-53e7-4da3-aaba-cd7aef9cc999]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:07 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD Nov 03 12:59:07 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:08 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 is fetched for user 00ba9412c36d4dbd85329591f3232ef5. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c683030-2a7e-46d3-a2cf-6ad26f4a3368]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:08 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD Nov 03 12:59:08 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:08 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1759898722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0552c7d6-3450-4a0a-b093-ebd91165ef36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2170070f3544823a07869db9323c920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:06Z,use_quota=True,user_id='00ba9412c36d4dbd85329591f3232ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Creating volume 0552c7d6-3450-4a0a-b093-ebd91165ef36 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:08 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:08 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 1073741824 Nov 03 12:59:08 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:09 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 1073741824" returned: 0 in 0.632s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:09 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 Nov 03 12:59:09 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:09 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Attempting download of 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 0552c7d6-3450-4a0a-b093-ebd91165ef36. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8306007-f05e-44d9-b200-32d0eb39e193]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_h6exexn6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:09 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_h6exexn6 Nov 03 12:59:09 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:10 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_h6exexn6" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_h6exexn6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:10 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_h6exexn6 Nov 03 12:59:10 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:10 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_h6exexn6" returned: 1 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_h6exexn6' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 12:59:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d9e7e4-8871-43ee-badb-706bc79444ca]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-acdec583-9672-4baa-a194-f0763a9e56ff tempest-GroupsTest-144167640 None] Group tempest-Group1-736189397: creating Nov 03 12:59:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-acdec583-9672-4baa-a194-f0763a9e56ff tempest-GroupsTest-144167640 None] Group tempest-Group1-736189397: created successfully Nov 03 12:59:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-acdec583-9672-4baa-a194-f0763a9e56ff tempest-GroupsTest-144167640 None] Create group completed successfully. Nov 03 12:59:10 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD Nov 03 12:59:10 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:11 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:11 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] 68321eb5-d635-47b3-850b-90ed52040d26 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 12:59:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:11 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 Nov 03 12:59:11 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cdc274df-2996-4243-9b24-0ae486d5ab99 tempest-GroupsTest-144167640 None] Group tempest-Group2-1147193236: creating Nov 03 12:59:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cdc274df-2996-4243-9b24-0ae486d5ab99 tempest-GroupsTest-144167640 None] Group tempest-Group2-1147193236: created successfully Nov 03 12:59:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cdc274df-2996-4243-9b24-0ae486d5ab99 tempest-GroupsTest-144167640 None] Create group completed successfully. Nov 03 12:59:13 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36" returned: 0 in 2.409s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:13 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_2k2kosoydevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 12:59:13 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Converted 112.00 MB image at 46.47 MB/s Nov 03 12:59:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:13 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 1G Nov 03 12:59:13 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:13 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Flow 'volume_create_manager' (a106960c-507d-4c97-a50d-518a4b52a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7da626-35ea-41ad-8d13-912cc1d067cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7da626-35ea-41ad-8d13-912cc1d067cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-290087322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9bec564f-df43-4683-aad0-c32735a7e902,host='devstack@QuobyteHD#QuobyteHD',id=d185eb00-7589-4553-8726-28a06c5df0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b58eb83eeb4e7b8d197ee394708719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:14Z,use_quota=True,user_id='779ec77e0dc84bb49cb10d3e0e79f2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96933ca0-8642-444c-a859-2dfad7e1e001),volume_type_id=96933ca0-8642-444c-a859-2dfad7e1e001)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db64ffc4-4354-43bf-98ec-35b5b3774c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db64ffc4-4354-43bf-98ec-35b5b3774c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045668a-28dd-427d-9b6b-082b06393e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045668a-28dd-427d-9b6b-082b06393e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd185eb00-7589-4553-8726-28a06c5df0a6', 'volume_name': 'volume-d185eb00-7589-4553-8726-28a06c5df0a6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c135930-df3d-454d-808b-62fb77c104f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c135930-df3d-454d-808b-62fb77c104f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707b22a9-4a5b-41b2-a514-651651157859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Volume d185eb00-7589-4553-8726-28a06c5df0a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d185eb00-7589-4553-8726-28a06c5df0a6', 'volume_size': 1} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9bec564f-df43-4683-aad0-c32735a7e902,created_at=2026-11-03T11:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-290087322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9bec564f-df43-4683-aad0-c32735a7e902,host='devstack@QuobyteHD#QuobyteHD',id=d185eb00-7589-4553-8726-28a06c5df0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b58eb83eeb4e7b8d197ee394708719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:14Z,use_quota=True,user_id='779ec77e0dc84bb49cb10d3e0e79f2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96933ca0-8642-444c-a859-2dfad7e1e001),volume_type_id=96933ca0-8642-444c-a859-2dfad7e1e001)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Creating volume d185eb00-7589-4553-8726-28a06c5df0a6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:14 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 1073741824 Nov 03 12:59:14 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:14 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 1G" returned: 0 in 0.605s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Downloaded image 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 0552c7d6-3450-4a0a-b093-ebd91165ef36 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 for user 00ba9412c36d4dbd85329591f3232ef5 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Marking volume 0552c7d6-3450-4a0a-b093-ebd91165ef36 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Copying metadata from image 68321eb5-d635-47b3-850b-90ed52040d26 to 0552c7d6-3450-4a0a-b093-ebd91165ef36. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Creating volume glance metadata for volume 0552c7d6-3450-4a0a-b093-ebd91165ef36 backed by image 68321eb5-d635-47b3-850b-90ed52040d26 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6778c913-f94b-4027-b51b-0e48e59429e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0552c7d6-3450-4a0a-b093-ebd91165ef36', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18d5a7e-635d-411e-bde9-f602e4d69a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Volume volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 (0552c7d6-3450-4a0a-b093-ebd91165ef36): created successfully Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18d5a7e-635d-411e-bde9-f602e4d69a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Flow 'volume_create_manager' (f91bed38-b885-405c-9aeb-3941ec119e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-729ab175-3dfe-4fa6-8d45-a6a715a74088 tempest-ServerActionsTestOtherA-1693733663 None] Created volume successfully. Nov 03 12:59:14 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 1073741824" returned: 0 in 0.551s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:14 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 Nov 03 12:59:14 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:14 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707b22a9-4a5b-41b2-a514-651651157859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d185eb00-7589-4553-8726-28a06c5df0a6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4594f37-defb-4cd7-a559-9e9d24f8a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Volume volume-d185eb00-7589-4553-8726-28a06c5df0a6 (d185eb00-7589-4553-8726-28a06c5df0a6): created successfully Nov 03 12:59:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4594f37-defb-4cd7-a559-9e9d24f8a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Flow 'volume_create_manager' (a106960c-507d-4c97-a50d-518a4b52a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0bc6faf8-f1f7-4f2b-8fd4-8bd1e146c424 tempest-GroupsTest-144167640 None] Created volume successfully. Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Flow 'volume_create_manager' (c628fbc3-699b-4c9a-84b7-8c2bbaef99df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfad28ad-648c-4ec8-8c9f-8b10214c3aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfad28ad-648c-4ec8-8c9f-8b10214c3aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581434183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb6abf7-28ae-4bbe-b2ac-d413c4041790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64364fe40f3f4eefba646feaa34d2d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:17Z,use_quota=True,user_id='6b2d96db91884e689faabc4cb753610e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d29b80-8329-4a60-9961-661fea8e06a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d29b80-8329-4a60-9961-661fea8e06a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c6a1d3-e58e-40e1-9c99-7219f3f4d34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c6a1d3-e58e-40e1-9c99-7219f3f4d34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb6abf7-28ae-4bbe-b2ac-d413c4041790', 'volume_name': 'volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8dbabd-1c7b-4044-bbfb-5d10d4803c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8dbabd-1c7b-4044-bbfb-5d10d4803c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edd29d1-4e0a-4554-8c0a-693e08dbcd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Volume eeb6abf7-28ae-4bbe-b2ac-d413c4041790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790', 'volume_size': 1} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581434183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb6abf7-28ae-4bbe-b2ac-d413c4041790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64364fe40f3f4eefba646feaa34d2d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:17Z,use_quota=True,user_id='6b2d96db91884e689faabc4cb753610e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Creating volume eeb6abf7-28ae-4bbe-b2ac-d413c4041790 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:17 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 1073741824 Nov 03 12:59:17 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Acquiring lock "cinder-quobyte-d185eb00-7589-4553-8726-28a06c5df0a6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Lock "cinder-quobyte-d185eb00-7589-4553-8726-28a06c5df0a6" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd678416-426d-4598-b21a-18aa47b8dfd8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:17 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 Nov 03 12:59:17 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:17 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 1073741824" returned: 0 in 0.645s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:18 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 Nov 03 12:59:18 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6987cfa3-9333-439c-8d9e-48849655edc5 req-7edd53a7-061a-43cb-a188-f8ba04f22d6f tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:18 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6" returned: 0 in 0.492s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:18 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6 Nov 03 12:59:18 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:18 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6987cfa3-9333-439c-8d9e-48849655edc5 req-7edd53a7-061a-43cb-a188-f8ba04f22d6f tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.169s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edd29d1-4e0a-4554-8c0a-693e08dbcd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3537971b-0873-41b9-85db-87123c2a2487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6987cfa3-9333-439c-8d9e-48849655edc5 req-7edd53a7-061a-43cb-a188-f8ba04f22d6f tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Volume volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 (eeb6abf7-28ae-4bbe-b2ac-d413c4041790): created successfully Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3537971b-0873-41b9-85db-87123c2a2487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Flow 'volume_create_manager' (c628fbc3-699b-4c9a-84b7-8c2bbaef99df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e66e22c9-ac84-4f57-8936-c69c1906445a tempest-VolumesListAdminTestJSON-2081053614 None] Created volume successfully. Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6987cfa3-9333-439c-8d9e-48849655edc5 req-7edd53a7-061a-43cb-a188-f8ba04f22d6f tempest-ServerActionsTestOtherA-1693733663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-0552c7d6-3450-4a0a-b093-ebd91165ef36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '761b7ec8-355e-4138-ac44-8382d3f8e149', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:59:18 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d185eb00-7589-4553-8726-28a06c5df0a6" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Lock "cinder-quobyte-d185eb00-7589-4553-8726-28a06c5df0a6" released by "delete_volume" :: held 0.863s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-6987cfa3-9333-439c-8d9e-48849655edc5 req-7edd53a7-061a-43cb-a188-f8ba04f22d6f tempest-ServerActionsTestOtherA-1693733663 None] attachment_update completed successfully. Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Created reservations ['619946c6-1ecf-4af9-aad4-9aea3479ec8a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:18 devstack cinder-volume[86369]: WARNING cinder.quota [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-585690841 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-585690841, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:59:18 devstack cinder-volume[86369]: WARNING cinder.quota [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-585690841 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-585690841, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Created reservations ['6823d804-b5bd-4292-9c1d-88b9e317f3d6', 'a2b0f641-95c8-4cc4-81f6-a8a630ae83be', '54ac20f1-3460-417e-b555-3d05436d87b1', 'c11f17d0-2916-49f4-81db-ea3a79194534'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:18 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:18 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Created reservations ['c7892afa-6010-4b09-8ac7-3a8876554d91'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:19 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-38bd4bf4-ab4d-456c-8113-b19481e5b01f tempest-GroupsTest-144167640 None] Delete group completed successfully. Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:19 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:19 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:19 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-af78360a-2d74-4ae5-b56d-d69be528e062 tempest-GroupsTest-144167640 None] Delete group completed successfully. Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Flow 'volume_create_manager' (54c9a5ad-29e7-44ac-8754-986ba9ed4c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a247a7e7-3964-42b3-b09d-8e6597e6e53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a247a7e7-3964-42b3-b09d-8e6597e6e53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1416381584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64364fe40f3f4eefba646feaa34d2d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:20Z,use_quota=True,user_id='6b2d96db91884e689faabc4cb753610e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9605237e-0030-4674-bdfd-bfcd0b3ade5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9605237e-0030-4674-bdfd-bfcd0b3ade5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a26e07-c12d-45ee-82f0-a1f6637d8329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a26e07-c12d-45ee-82f0-a1f6637d8329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b', 'volume_name': 'volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa858802-870c-41bf-ae9d-a8ca4142e69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa858802-870c-41bf-ae9d-a8ca4142e69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826cd81-63b2-41d7-a59f-6165f92bffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Volume 2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b', 'volume_size': 1} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1416381584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64364fe40f3f4eefba646feaa34d2d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:20Z,use_quota=True,user_id='6b2d96db91884e689faabc4cb753610e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Creating volume 2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:19 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b 1073741824 Nov 03 12:59:19 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:20 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b 1073741824" returned: 0 in 0.589s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:20 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b Nov 03 12:59:20 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:20 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8826cd81-63b2-41d7-a59f-6165f92bffc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773a0700-925c-41c3-9a3e-20a162f598e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Volume volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b (2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b): created successfully Nov 03 12:59:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773a0700-925c-41c3-9a3e-20a162f598e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Flow 'volume_create_manager' (54c9a5ad-29e7-44ac-8754-986ba9ed4c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b9767376-9317-4256-9638-84004617b61d tempest-VolumesListAdminTestJSON-2081053614 None] Created volume successfully. Nov 03 12:59:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8879fd25-eb33-47e0-b412-6c95ae4bb4e7 tempest-GroupsTest-144167640 None] Group tempest-GroupsTest-Group-477658854: creating Nov 03 12:59:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8879fd25-eb33-47e0-b412-6c95ae4bb4e7 tempest-GroupsTest-144167640 None] Group tempest-GroupsTest-Group-477658854: created successfully Nov 03 12:59:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8879fd25-eb33-47e0-b412-6c95ae4bb4e7 tempest-GroupsTest-144167640 None] Create group completed successfully. Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Flow 'volume_create_manager' (99ae6d17-fbd9-4596-982c-c2083f9d17b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f9ff23-1a38-4564-bada-eed70e70f404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f9ff23-1a38-4564-bada-eed70e70f404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-323297557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dd7523-2c1c-4004-847d-c8d1f8f33e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64364fe40f3f4eefba646feaa34d2d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:22Z,use_quota=True,user_id='6b2d96db91884e689faabc4cb753610e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980d01c2-910a-47f1-befb-e12cd331917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980d01c2-910a-47f1-befb-e12cd331917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2213a45d-eeda-4f92-aa01-0b6fc47e9f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2213a45d-eeda-4f92-aa01-0b6fc47e9f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27dd7523-2c1c-4004-847d-c8d1f8f33e37', 'volume_name': 'volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3ac516-2602-42b3-bf5c-7bd219b5d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3ac516-2602-42b3-bf5c-7bd219b5d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd98467a-b90a-4584-8220-6e9b5a1c28cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Volume 27dd7523-2c1c-4004-847d-c8d1f8f33e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37', 'volume_size': 1} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-323297557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dd7523-2c1c-4004-847d-c8d1f8f33e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64364fe40f3f4eefba646feaa34d2d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:22Z,use_quota=True,user_id='6b2d96db91884e689faabc4cb753610e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Creating volume 27dd7523-2c1c-4004-847d-c8d1f8f33e37 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:22 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 1073741824 Nov 03 12:59:22 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Flow 'volume_create_manager' (89be879b-3f54-481d-925c-70013440c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f97b4a-974f-48b4-bc52-1e4983c1aa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f97b4a-974f-48b4-bc52-1e4983c1aa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-261558747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7624c06-b96f-4d17-892c-52e7bf1e4f5b,host='devstack@QuobyteHD#QuobyteHD',id=32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b58eb83eeb4e7b8d197ee394708719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:23Z,use_quota=True,user_id='779ec77e0dc84bb49cb10d3e0e79f2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8749e363-dbcb-44c8-9798-d33f0bbdb5fd),volume_type_id=8749e363-dbcb-44c8-9798-d33f0bbdb5fd)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fdc869-94b7-49b7-a610-586ee1cfc2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fdc869-94b7-49b7-a610-586ee1cfc2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd45a86-54d3-4133-af5e-32a76b62b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd45a86-54d3-4133-af5e-32a76b62b506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e', 'volume_name': 'volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579f6a88-5012-4bd8-bd0b-b8ceeab0ebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579f6a88-5012-4bd8-bd0b-b8ceeab0ebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352fbca6-fe9d-4e70-a9fd-c725ab720d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Volume 32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e', 'volume_size': 1} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:23 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 1073741824" returned: 0 in 0.722s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:23 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 Nov 03 12:59:23 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:23 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7624c06-b96f-4d17-892c-52e7bf1e4f5b,created_at=2026-11-03T11:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-261558747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7624c06-b96f-4d17-892c-52e7bf1e4f5b,host='devstack@QuobyteHD#QuobyteHD',id=32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b58eb83eeb4e7b8d197ee394708719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:23Z,use_quota=True,user_id='779ec77e0dc84bb49cb10d3e0e79f2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8749e363-dbcb-44c8-9798-d33f0bbdb5fd),volume_type_id=8749e363-dbcb-44c8-9798-d33f0bbdb5fd)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Creating volume 32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:23 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:23 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e 1073741824 Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd98467a-b90a-4584-8220-6e9b5a1c28cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:23 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3609c8bd-47a7-4a08-8669-07b6bf45031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Volume volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 (27dd7523-2c1c-4004-847d-c8d1f8f33e37): created successfully Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3609c8bd-47a7-4a08-8669-07b6bf45031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Flow 'volume_create_manager' (99ae6d17-fbd9-4596-982c-c2083f9d17b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6b549c8f-ea1c-4d2c-a0bc-0984d041920d tempest-VolumesListAdminTestJSON-2081053614 None] Created volume successfully. Nov 03 12:59:24 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e 1073741824" returned: 0 in 0.653s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:24 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e Nov 03 12:59:24 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:24 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352fbca6-fe9d-4e70-a9fd-c725ab720d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09610daf-8540-4016-9f13-baf8ce2ee0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Volume volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e (32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e): created successfully Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09610daf-8540-4016-9f13-baf8ce2ee0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Flow 'volume_create_manager' (89be879b-3f54-481d-925c-70013440c510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-051fef3b-c848-4596-9832-b40b1f9f7beb tempest-GroupsTest-144167640 None] Created volume successfully. Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Flow 'volume_create_manager' (f2c4d949-ae83-4086-8e31-2fc9b8d2046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8560c2ee-6cf8-423e-a1f8-749a6f9ea163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8560c2ee-6cf8-423e-a1f8-749a6f9ea163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8079fb58-8f8d-4879-a1fe-43d760c231ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ffc39832544230b80d7bcf13045158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:26Z,use_quota=True,user_id='f59e4a8c95984edca6ec80037e970077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a76cbd5-9610-4afd-8f16-5d210bf9831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a76cbd5-9610-4afd-8f16-5d210bf9831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d87dd41-15bf-4d4b-8c8f-915763280ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d87dd41-15bf-4d4b-8c8f-915763280ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8079fb58-8f8d-4879-a1fe-43d760c231ad', 'volume_name': 'volume-8079fb58-8f8d-4879-a1fe-43d760c231ad', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d93a3b3-d757-4dca-a73e-3c943a6e0d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d93a3b3-d757-4dca-a73e-3c943a6e0d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113bf5b5-eadc-49b3-8d33-cf598a41cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Volume 8079fb58-8f8d-4879-a1fe-43d760c231ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8079fb58-8f8d-4879-a1fe-43d760c231ad', 'volume_size': 1} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8079fb58-8f8d-4879-a1fe-43d760c231ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ffc39832544230b80d7bcf13045158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:26Z,use_quota=True,user_id='f59e4a8c95984edca6ec80037e970077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Creating volume 8079fb58-8f8d-4879-a1fe-43d760c231ad {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:26 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:26 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad 1073741824 Nov 03 12:59:26 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Flow 'volume_create_manager' (c02d5134-8946-452f-af15-609ebf45aec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f389b0-d274-4594-a6eb-6117c392468a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f389b0-d274-4594-a6eb-6117c392468a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-313174155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7624c06-b96f-4d17-892c-52e7bf1e4f5b,host='devstack@QuobyteHD#QuobyteHD',id=fee866d5-7b3c-47a8-822a-cfdf6527a8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b58eb83eeb4e7b8d197ee394708719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:27Z,use_quota=True,user_id='779ec77e0dc84bb49cb10d3e0e79f2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8749e363-dbcb-44c8-9798-d33f0bbdb5fd),volume_type_id=8749e363-dbcb-44c8-9798-d33f0bbdb5fd)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1d8556-f1c7-493e-947f-5c0b03234e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1d8556-f1c7-493e-947f-5c0b03234e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4923908-cf05-4702-9f01-7ccd5b9d6a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4923908-cf05-4702-9f01-7ccd5b9d6a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee866d5-7b3c-47a8-822a-cfdf6527a8ad', 'volume_name': 'volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2527feca-1d88-49d5-a98d-8d445c9c73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2527feca-1d88-49d5-a98d-8d445c9c73fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f14d2-b21a-4c3b-82cb-1c7430464ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Volume fee866d5-7b3c-47a8-822a-cfdf6527a8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad', 'volume_size': 1} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:27 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad 1073741824" returned: 0 in 0.822s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:27 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad Nov 03 12:59:27 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:27 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7624c06-b96f-4d17-892c-52e7bf1e4f5b,created_at=2026-11-03T11:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-313174155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7624c06-b96f-4d17-892c-52e7bf1e4f5b,host='devstack@QuobyteHD#QuobyteHD',id=fee866d5-7b3c-47a8-822a-cfdf6527a8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b58eb83eeb4e7b8d197ee394708719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:27Z,use_quota=True,user_id='779ec77e0dc84bb49cb10d3e0e79f2e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8749e363-dbcb-44c8-9798-d33f0bbdb5fd),volume_type_id=8749e363-dbcb-44c8-9798-d33f0bbdb5fd)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Creating volume fee866d5-7b3c-47a8-822a-cfdf6527a8ad {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:28 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:28 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad 1073741824 Nov 03 12:59:28 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113bf5b5-eadc-49b3-8d33-cf598a41cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8079fb58-8f8d-4879-a1fe-43d760c231ad', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9254a007-678c-4992-871a-74b6815e1c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Volume volume-8079fb58-8f8d-4879-a1fe-43d760c231ad (8079fb58-8f8d-4879-a1fe-43d760c231ad): created successfully Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9254a007-678c-4992-871a-74b6815e1c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Flow 'volume_create_manager' (f2c4d949-ae83-4086-8e31-2fc9b8d2046a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-924f7ae1-fc0c-49a7-b6f6-1daf358703a5 tempest-VolumesListAdminTestJSON-535345871 None] Created volume successfully. Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Acquiring lock "cinder-8079fb58-8f8d-4879-a1fe-43d760c231ad-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Lock "cinder-8079fb58-8f8d-4879-a1fe-43d760c231ad-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:29 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Acquiring lock "cinder-quobyte-8079fb58-8f8d-4879-a1fe-43d760c231ad" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad 1073741824" returned: 0 in 1.098s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Lock "cinder-quobyte-8079fb58-8f8d-4879-a1fe-43d760c231ad" acquired by "delete_volume" :: waited 0.102s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3de019-1594-4155-81db-599feac54929]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "cinder-27dd7523-2c1c-4004-847d-c8d1f8f33e37-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-27dd7523-2c1c-4004-847d-c8d1f8f33e37-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:29 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad Nov 03 12:59:29 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "cinder-quobyte-27dd7523-2c1c-4004-847d-c8d1f8f33e37" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-quobyte-27dd7523-2c1c-4004-847d-c8d1f8f33e37" acquired by "delete_volume" :: waited 0.076s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:29 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad Nov 03 12:59:29 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b356b9f7-3def-4351-89f5-68810dc2bb51]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:29 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 Nov 03 12:59:29 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:30 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad" returned: 0 in 0.736s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f14d2-b21a-4c3b-82cb-1c7430464ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505f86af-f550-4032-9347-eb4295e0230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Volume volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad (fee866d5-7b3c-47a8-822a-cfdf6527a8ad): created successfully Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505f86af-f550-4032-9347-eb4295e0230f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Flow 'volume_create_manager' (c02d5134-8946-452f-af15-609ebf45aec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f60d19db-4149-4ede-933f-4a03b7869a7c tempest-GroupsTest-144167640 None] Created volume successfully. Nov 03 12:59:30 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad" returned: 0 in 1.161s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:30 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad Nov 03 12:59:30 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:30 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37" returned: 0 in 0.959s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:30 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37 Nov 03 12:59:30 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:31 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8079fb58-8f8d-4879-a1fe-43d760c231ad" returned: 0 in 0.625s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Lock "cinder-quobyte-8079fb58-8f8d-4879-a1fe-43d760c231ad" released by "delete_volume" :: held 1.919s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:31 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-27dd7523-2c1c-4004-847d-c8d1f8f33e37" returned: 0 in 0.512s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-quobyte-27dd7523-2c1c-4004-847d-c8d1f8f33e37" released by "delete_volume" :: held 1.602s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Created reservations ['9b3840fa-7e65-4e9f-9300-a471d0f5fd38', '1d4fb32a-1457-45db-b10e-730309cd0171', 'c1b4c337-282d-4643-ad95-cebc6dc46c58', 'a2c0a56d-fc8a-49c5-a153-b368dec272a6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Created reservations ['43a6c622-f656-45ea-a887-f3c7a076a494', '67df6516-542d-4507-8fc7-ea3f52947ddf', '63b4d1c6-9e3d-4e4e-b93f-eb98167933c7', '0483bf4d-ca5c-4b89-bcb8-e44a5ace3743'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4be11789-5d91-455e-a2fd-cdf9bb7259e4 tempest-GroupsTest-144167640 None] Update group completed successfully. Nov 03 12:59:31 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:31 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:31 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:31 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "cinder-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:32 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.527s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Deleted volume successfully. Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "cinder-quobyte-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-73cb4f47-69de-4f12-bf62-e65181b4b774 tempest-VolumesListAdminTestJSON-535345871 None] Lock "cinder-8079fb58-8f8d-4879-a1fe-43d760c231ad-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-quobyte-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9133f91d-f391-4d7f-8b72-a021a7bc5b9e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:32 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.680s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Deleted volume successfully. Nov 03 12:59:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8fc2fd99-c2c5-4170-9145-277cc232134e tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-27dd7523-2c1c-4004-847d-c8d1f8f33e37-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:32 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b Nov 03 12:59:32 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:33 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b" returned: 0 in 0.796s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:33 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b Nov 03 12:59:33 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-be8ea4df-c72f-4c12-8998-2f52d2156167 tempest-GroupsTest-144167640 None] Update group completed successfully. Nov 03 12:59:33 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b" returned: 0 in 0.429s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-quobyte-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b" released by "delete_volume" :: held 1.285s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Created reservations ['ab9297b6-ba67-4543-a7fe-267213155e6f', '45b61a8a-bd35-48ce-9e3f-16fca3d669a7', '1179997b-b70a-4b52-a947-e3f80b84e8c8', 'f8cc0fd6-a14d-46bc-8e1f-1da70dd840d2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:33 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:33 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:33 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Deleted volume successfully. Nov 03 12:59:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-707505b7-c13f-4b80-9616-746750d1a0fa tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-2d86cc18-9ac1-4545-8f8c-c53aaaa62f4b-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "cinder-eeb6abf7-28ae-4bbe-b2ac-d413c4041790-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-eeb6abf7-28ae-4bbe-b2ac-d413c4041790-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-e7e16b9e-d72a-48a7-bb62-f56aa977a353 req-6a07175d-6fd4-4584-a2d8-aff55643d17e tempest-ServerActionsTestOtherA-1693733663 None] Terminate volume connection completed successfully. Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-e7e16b9e-d72a-48a7-bb62-f56aa977a353 req-6a07175d-6fd4-4584-a2d8-aff55643d17e tempest-ServerActionsTestOtherA-1693733663 None] Deleting attachment 761b7ec8-355e-4138-ac44-8382d3f8e149. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "cinder-quobyte-eeb6abf7-28ae-4bbe-b2ac-d413c4041790" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-quobyte-eeb6abf7-28ae-4bbe-b2ac-d413c4041790" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c96139-7bdb-42b2-b64b-759041a95d71]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:35 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 Nov 03 12:59:35 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:35 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790" returned: 0 in 0.693s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Acquiring lock "cinder-quobyte-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:35 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790 Nov 03 12:59:35 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Lock "cinder-quobyte-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc3da17-9cce-45ba-ba05-09dc29cb234e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:36 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e Nov 03 12:59:36 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:36 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-eeb6abf7-28ae-4bbe-b2ac-d413c4041790" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-quobyte-eeb6abf7-28ae-4bbe-b2ac-d413c4041790" released by "delete_volume" :: held 1.210s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=118,cinder:UPDATE=116,cinder:INSERT=33,cinder:DELETE=10 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=120,cinder:SELECT=99,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Created reservations ['274d3c12-c2b1-421d-ac27-c1f95d109e64', 'db73b2cb-a7b1-4a63-a31d-49f3d764c426', '0f8101ce-a60e-4afe-bb89-9fe5bbd71e67', '9efbac01-8872-4178-ac8f-6f6f0c0f5c82'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:36 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e" returned: 0 in 0.482s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:36 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e Nov 03 12:59:36 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:36 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:36 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:36 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:36 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e" returned: 0 in 0.340s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Deleted volume successfully. Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Lock "cinder-quobyte-32c1fb8e-72b9-43c8-92fe-a9ca8cbed63e" released by "delete_volume" :: held 0.917s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Acquiring lock "cinder-quobyte-fee866d5-7b3c-47a8-822a-cfdf6527a8ad" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Lock "cinder-quobyte-fee866d5-7b3c-47a8-822a-cfdf6527a8ad" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd599825-ee16-45a3-94fa-981230325385 tempest-VolumesListAdminTestJSON-2081053614 None] Lock "cinder-eeb6abf7-28ae-4bbe-b2ac-d413c4041790-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae8370-6914-4d91-8e3b-697604103ea3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:37 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad Nov 03 12:59:37 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-e7e16b9e-d72a-48a7-bb62-f56aa977a353 req-78843e2b-16f5-45d7-9187-f1da34d023b9 tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-e7e16b9e-d72a-48a7-bb62-f56aa977a353 req-78843e2b-16f5-45d7-9187-f1da34d023b9 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-e7e16b9e-d72a-48a7-bb62-f56aa977a353 req-78843e2b-16f5-45d7-9187-f1da34d023b9 tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-e7e16b9e-d72a-48a7-bb62-f56aa977a353 req-78843e2b-16f5-45d7-9187-f1da34d023b9 tempest-ServerActionsTestOtherA-1693733663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-0552c7d6-3450-4a0a-b093-ebd91165ef36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '906ab6a5-16b2-4eae-b128-5fcfb534dce3', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 12:59:37 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad" returned: 0 in 0.592s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-e7e16b9e-d72a-48a7-bb62-f56aa977a353 req-78843e2b-16f5-45d7-9187-f1da34d023b9 tempest-ServerActionsTestOtherA-1693733663 None] attachment_update completed successfully. Nov 03 12:59:37 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad Nov 03 12:59:37 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:37 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fee866d5-7b3c-47a8-822a-cfdf6527a8ad" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Lock "cinder-quobyte-fee866d5-7b3c-47a8-822a-cfdf6527a8ad" released by "delete_volume" :: held 1.004s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Created reservations ['d019df0d-3981-46ed-a39c-f3a6c9b2f6f4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:38 devstack cinder-volume[86369]: WARNING cinder.quota [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1323755419 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1323755419, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:59:38 devstack cinder-volume[86369]: WARNING cinder.quota [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1323755419 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1323755419, it is now deprecated. Please use the default quota class for default quota. Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Created reservations ['97e1a6ad-eeb7-4178-954b-ca662f60649f', 'cfc584c4-39cf-4ba5-bb36-a285bc95aedc', '8e3bcafa-7b18-4408-8405-372d08c9096e', '6413b23f-94b5-487a-9090-c37f2ed30181'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Created reservations ['8611a0b9-62aa-4fb3-b3a1-4f6e7bfc63ba', '052d6e94-7986-490a-91b1-913dd5d5a8af', '07efa9cd-377f-4d97-a2bb-07b8548824de', '05573812-049c-423f-b249-092873821c55'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:38 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:38 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:38 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1fddca46-6172-47c7-a773-506d180909f0 tempest-GroupsTest-144167640 None] Delete group completed successfully. Nov 03 12:59:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=22,cinder:SELECT=23,cinder:INSERT=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:59:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=20,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Flow 'volume_create_manager' (c2d12c19-79a1-498b-9bf9-927b5d08cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247b4248-527e-4372-84b0-a43007e167ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247b4248-527e-4372-84b0-a43007e167ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1044972563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03060bb4-630e-4421-a4aa-6ec0f367108e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bd5dd98e26470db4e6383b5950dc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:50Z,use_quota=True,user_id='7102a12276144ca8bacaeda2c908f10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59d8476-90f7-42e5-8423-979896f2ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59d8476-90f7-42e5-8423-979896f2ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408c1f22-008a-4761-845a-6118934b6995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408c1f22-008a-4761-845a-6118934b6995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03060bb4-630e-4421-a4aa-6ec0f367108e', 'volume_name': 'volume-03060bb4-630e-4421-a4aa-6ec0f367108e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6efd070-ec8e-4e4d-a58f-7cb68be42cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6efd070-ec8e-4e4d-a58f-7cb68be42cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24257149-64d5-4272-b6ac-5058456dc8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Volume 03060bb4-630e-4421-a4aa-6ec0f367108e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03060bb4-630e-4421-a4aa-6ec0f367108e', 'volume_size': 1} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T11:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1044972563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03060bb4-630e-4421-a4aa-6ec0f367108e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bd5dd98e26470db4e6383b5950dc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T11:59:50Z,use_quota=True,user_id='7102a12276144ca8bacaeda2c908f10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Creating volume 03060bb4-630e-4421-a4aa-6ec0f367108e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 12:59:50 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 12:59:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:50 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e 1073741824 Nov 03 12:59:50 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:51 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e 1073741824" returned: 0 in 0.784s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:51 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e Nov 03 12:59:51 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:52 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e" returned: 0 in 0.561s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 12:59:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24257149-64d5-4272-b6ac-5058456dc8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03060bb4-630e-4421-a4aa-6ec0f367108e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e9a574-3232-4e2d-812a-7c79e2a56498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 12:59:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Volume volume-03060bb4-630e-4421-a4aa-6ec0f367108e (03060bb4-630e-4421-a4aa-6ec0f367108e): created successfully Nov 03 12:59:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e9a574-3232-4e2d-812a-7c79e2a56498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 12:59:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Flow 'volume_create_manager' (c2d12c19-79a1-498b-9bf9-927b5d08cce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 12:59:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-937832b2-f889-45bf-b82e-bacea6a64b51 tempest-AbsoluteLimitsTests-1705463006 None] Created volume successfully. Nov 03 12:59:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Acquiring lock "cinder-03060bb4-630e-4421-a4aa-6ec0f367108e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Lock "cinder-03060bb4-630e-4421-a4aa-6ec0f367108e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Acquiring lock "cinder-quobyte-03060bb4-630e-4421-a4aa-6ec0f367108e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 12:59:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Lock "cinder-quobyte-03060bb4-630e-4421-a4aa-6ec0f367108e" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 12:59:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d449be7a-c7cb-47ef-b0ed-8f7aa35ae664]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 12:59:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:54 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e Nov 03 12:59:54 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:55 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e" returned: 0 in 0.787s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:55 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e Nov 03 12:59:55 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:55 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-03060bb4-630e-4421-a4aa-6ec0f367108e" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Lock "cinder-quobyte-03060bb4-630e-4421-a4aa-6ec0f367108e" released by "delete_volume" :: held 1.228s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Created reservations ['a595f27b-aee0-43ba-ade9-3f2a0e72b971', 'ff06dbe2-027b-4a68-adb6-d585fe06a6d3', 'f06fab33-7c78-4766-a290-268bc7559800', '46831fae-52fe-4715-aa11-aed391eae343'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:55 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:55 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:55 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Deleted volume successfully. Nov 03 12:59:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-12ed649e-8afe-489b-b042-c41783cdc2de tempest-AbsoluteLimitsTests-1705463006 None] Lock "cinder-03060bb4-630e-4421-a4aa-6ec0f367108e-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 12:59:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:59:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 12:59:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 12:59:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 12:59:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 12:59:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 12:59:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 12:59:58 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 12:59:58 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 12:59:59 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Nov 03 12:59:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 12:59:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 12:59:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 12:59:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 12:59:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Flow 'volume_create_manager' (b99eaf48-337d-413b-8437-d6bb1d765241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b65f599-dc2f-4f5b-9485-66430839805e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b65f599-dc2f-4f5b-9485-66430839805e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2129744892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c709344-496f-4625-a7ad-ab395c7dcbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e327941962459dab1f78e47d7db282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:03Z,use_quota=True,user_id='7876e951ebe847f39fd6b5cc99f8dd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099b3bb2-5390-4539-bd61-1a0ac262ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099b3bb2-5390-4539-bd61-1a0ac262ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cf89ad-eacd-4619-8545-15c32476f7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cf89ad-eacd-4619-8545-15c32476f7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c709344-496f-4625-a7ad-ab395c7dcbc8', 'volume_name': 'volume-5c709344-496f-4625-a7ad-ab395c7dcbc8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d55b1eb-1466-428c-9965-821d6a3bb84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d55b1eb-1466-428c-9965-821d6a3bb84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793bb705-d307-41db-868f-b8b68b822685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Volume 5c709344-496f-4625-a7ad-ab395c7dcbc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c709344-496f-4625-a7ad-ab395c7dcbc8', 'volume_size': 1} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2129744892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c709344-496f-4625-a7ad-ab395c7dcbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e327941962459dab1f78e47d7db282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:03Z,use_quota=True,user_id='7876e951ebe847f39fd6b5cc99f8dd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Creating volume 5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:03 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 1073741824 Nov 03 13:00:03 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:03 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 1073741824" returned: 0 in 0.499s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:03 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 Nov 03 13:00:03 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:03 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:00:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793bb705-d307-41db-868f-b8b68b822685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c709344-496f-4625-a7ad-ab395c7dcbc8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c740b129-7a0c-4fac-9904-1697f1816625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Volume volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 (5c709344-496f-4625-a7ad-ab395c7dcbc8): created successfully Nov 03 13:00:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c740b129-7a0c-4fac-9904-1697f1816625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Flow 'volume_create_manager' (b99eaf48-337d-413b-8437-d6bb1d765241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2268d705-32dd-497b-8591-de65c408403a tempest-VolumesDeleteCascade-1351072564 None] Created volume successfully. Nov 03 13:00:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Creating offline snapshot ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 of volume 5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:00:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[683a0d3f-1bba-47b5-a4ad-97e517c597d6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:05 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 Nov 03 13:00:05 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:05 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:05 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 1G Nov 03 13:00:05 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:06 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 1G" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:06 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 Nov 03 13:00:06 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:06 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:06 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 is being set with open permissions: ugo+rw Nov 03 13:00:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:06 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 Nov 03 13:00:06 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:06 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:07 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.info Nov 03 13:00:07 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:07 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.info" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:07 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.info is being set with open permissions: ugo+rw Nov 03 13:00:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:07 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.info Nov 03 13:00:07 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:07 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.info" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8967ee7e-b35b-4e37-ad54-c6cb9c277318 tempest-VolumesDeleteCascade-1351072564 None] Create snapshot completed successfully Nov 03 13:00:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Creating offline snapshot a1b8f7a2-f011-4bff-bf4f-17d5c223e536 of volume 5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:00:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9dce13-6374-44f7-9b61-61e3b061e20f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:08 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 Nov 03 13:00:08 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:09 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" returned: 0 in 0.361s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c709344-496f-4625-a7ad-ab395c7dcbc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:00:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:09 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 1G Nov 03 13:00:09 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:09 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 1G" returned: 0 in 0.439s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:09 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 Nov 03 13:00:09 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:09 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:09 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 is being set with open permissions: ugo+rw Nov 03 13:00:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:09 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 Nov 03 13:00:09 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:10 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536" returned: 0 in 0.246s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.465s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8d9eaf40-1a4d-4d17-89fa-37a0fc2d3e15 tempest-VolumesDeleteCascade-1351072564 None] Create snapshot completed successfully Nov 03 13:00:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-5c709344-496f-4625-a7ad-ab395c7dcbc8-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-5c709344-496f-4625-a7ad-ab395c7dcbc8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Performing cascade delete. {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-a1b8f7a2-f011-4bff-bf4f-17d5c223e536-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-a1b8f7a2-f011-4bff-bf4f-17d5c223e536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-a1b8f7a2-f011-4bff-bf4f-17d5c223e536" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-a1b8f7a2-f011-4bff-bf4f-17d5c223e536" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Deleting offline snapshot a1b8f7a2-f011-4bff-bf4f-17d5c223e536 of volume 5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] snapshot_file for this snap is: volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[16567a48-24a8-4370-adfa-6fc49c8fe0ce]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:11 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 Nov 03 13:00:11 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:11 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536" returned: 0 in 0.540s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c709344-496f-4625-a7ad-ab395c7dcbc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddff5267-898f-4826-98d6-f1f8603878b4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:12 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 Nov 03 13:00:12 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:12 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" returned: 0 in 0.771s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c709344-496f-4625-a7ad-ab395c7dcbc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:00:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:12 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 Nov 03 13:00:12 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:13 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536" returned: 0 in 0.578s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:13 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536 Nov 03 13:00:13 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:13 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.a1b8f7a2-f011-4bff-bf4f-17d5c223e536" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-a1b8f7a2-f011-4bff-bf4f-17d5c223e536" released by "_delete_snapshot" :: held 2.561s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" released by "delete_snapshot" :: held 2.591s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Created reservations ['1ecddd6a-3be5-4080-8f39-0743b0f9d38e', '48dd2013-d103-4d77-98b6-c2405275192e', '19a60a81-52f6-4c88-b8e3-512c40ad3b5b', '0410f8c2-d155-475b-843f-61322828d109'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Delete snapshot completed successfully. Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-a1b8f7a2-f011-4bff-bf4f-17d5c223e536-delete_snapshot" released by "delete_snapshot" :: held 2.825s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-ad06cc6d-d6fd-4324-a6f7-d4d2757ec512-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-ad06cc6d-d6fd-4324-a6f7-d4d2757ec512-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Deleting offline snapshot ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 of volume 5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] snapshot_file for this snap is: volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04be10d-b6ce-416e-beff-80bae2f3613b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:14 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 Nov 03 13:00:14 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-eedb83f9-069b-4ff1-98b4-9b802cee3ab6 tempest-ServerActionsTestOtherA-1693733663 None] Terminate volume connection completed successfully. Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-eedb83f9-069b-4ff1-98b4-9b802cee3ab6 tempest-ServerActionsTestOtherA-1693733663 None] Deleting attachment 906ab6a5-16b2-4eae-b128-5fcfb534dce3. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "cinder-0552c7d6-3450-4a0a-b093-ebd91165ef36-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:14 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" returned: 0 in 0.559s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c709344-496f-4625-a7ad-ab395c7dcbc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-0552c7d6-3450-4a0a-b093-ebd91165ef36-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52379ed-8624-42da-b418-cb190f1536a9]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "cinder-quobyte-0552c7d6-3450-4a0a-b093-ebd91165ef36" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-quobyte-0552c7d6-3450-4a0a-b093-ebd91165ef36" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6e5b29-15b0-416d-a81f-076746fc8d78]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:14 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 Nov 03 13:00:14 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:15 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 Nov 03 13:00:15 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:15 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8" returned: 0 in 0.499s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:15 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 Nov 03 13:00:15 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:15 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36" returned: 0 in 0.557s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:15 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36 Nov 03 13:00:15 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:15 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:15 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512 Nov 03 13:00:15 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:15 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0552c7d6-3450-4a0a-b093-ebd91165ef36" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-quobyte-0552c7d6-3450-4a0a-b093-ebd91165ef36" released by "delete_volume" :: held 0.947s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG cinder.quota [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Created reservations ['ed38ebc9-876c-40f0-a42d-1ab186e3a886', 'a79d8959-1951-4f2c-b651-98d4bcab0f95', '658efa9f-4ca1-440b-9745-9c7e94785abd', 'ede88b7f-17fe-435b-8eeb-b9ff0a0935b1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:15 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:15 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:15 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8.ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-ad06cc6d-d6fd-4324-a6f7-d4d2757ec512" released by "_delete_snapshot" :: held 1.973s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" released by "delete_snapshot" :: held 2.000s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "cinder-3cb49c65-c89a-46dd-8d00-e076ba12c0f8-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Created reservations ['798397b0-5469-4eb5-bb77-4d2f7ba0cc99', 'f5141034-bd44-4185-a5ca-1633847910eb', '9aa8de5a-ec2f-4005-857b-340f75ffbbda', '17b21d46-dd04-4c4a-a825-6bc86bea5123'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-3cb49c65-c89a-46dd-8d00-e076ba12c0f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "cinder-quobyte-3cb49c65-c89a-46dd-8d00-e076ba12c0f8" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-quobyte-3cb49c65-c89a-46dd-8d00-e076ba12c0f8" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Delete snapshot completed successfully. Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-ad06cc6d-d6fd-4324-a6f7-d4d2757ec512-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Snapshots deleted, issuing volume delete {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e849d85a-fc88-4b43-876a-56ab91c0b7c6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:16 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.manager [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Deleted volume successfully. Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f27e39-1385-41df-b299-7b7edddcdf5a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-c3c5056a-0109-4f6f-a4a0-63d93e83aae1 req-0505ee58-1e5b-44e2-917a-eed2a95fdb4a tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-0552c7d6-3450-4a0a-b093-ebd91165ef36-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:16 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 Nov 03 13:00:16 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:16 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 Nov 03 13:00:16 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:16 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8" returned: 0 in 0.438s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:16 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8 Nov 03 13:00:16 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:16 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:16 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8 Nov 03 13:00:16 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:16 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3cb49c65-c89a-46dd-8d00-e076ba12c0f8" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-quobyte-3cb49c65-c89a-46dd-8d00-e076ba12c0f8" released by "delete_volume" :: held 0.781s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:16 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5c709344-496f-4625-a7ad-ab395c7dcbc8" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Created reservations ['d0ad06da-dfa7-4b9f-9ec7-3272f8245215', 'eeb6e5db-7da3-435b-b126-69bc1540bf20', '57c33333-f11b-4924-9506-e22e3fd55d5f', '9338a1cb-9747-4404-9783-37ecd60192d4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-5c709344-496f-4625-a7ad-ab395c7dcbc8" released by "delete_volume" :: held 0.820s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Created reservations ['501c8769-56e8-4722-8c8e-d1c9d23bdd01', 'bcb7b135-a190-4725-8735-d97ae5fb92b3', '7d673aa5-b984-4209-b2ec-73153a910c10', 'cd3ff510-d5c8-44e9-8f05-b950060cb101'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:17 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:17 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:17 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:17 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:17 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Deleted volume successfully. Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1a8cf727-0195-42ac-a3dc-13ddb67a4caf tempest-ServerActionsTestOtherA-1693733663 None] Lock "cinder-3cb49c65-c89a-46dd-8d00-e076ba12c0f8-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:17 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.477s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Deleted volume successfully. Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ffe099eb-0f08-4881-bfd9-61b5bb186d61 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-5c709344-496f-4625-a7ad-ab395c7dcbc8-delete_volume" released by "delete_volume" :: held 6.790s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Flow 'volume_create_manager' (765111bc-ff31-4d05-9d21-35a425916cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9191c5f-7d81-4a1f-8d18-fe9ca06c5001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9191c5f-7d81-4a1f-8d18-fe9ca06c5001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1278038272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a18b3ef-a923-4f3b-b460-a6f159c2e737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781e3a418ab64f2a8d92a0f5fbe2400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:18Z,use_quota=True,user_id='e1925633abe447d2ac2618a86fe1b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc66ff49-1cc5-465e-8bb9-30bb7efa0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc66ff49-1cc5-465e-8bb9-30bb7efa0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a49f1af-1d96-481e-b586-b36999b46ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a49f1af-1d96-481e-b586-b36999b46ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a18b3ef-a923-4f3b-b460-a6f159c2e737', 'volume_name': 'volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e46a47-b555-4037-ad3a-284f83a691a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e46a47-b555-4037-ad3a-284f83a691a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cf22dc-b503-4ed1-b13b-42f7229fee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Volume 4a18b3ef-a923-4f3b-b460-a6f159c2e737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737', 'volume_size': 1} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1278038272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a18b3ef-a923-4f3b-b460-a6f159c2e737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781e3a418ab64f2a8d92a0f5fbe2400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:18Z,use_quota=True,user_id='e1925633abe447d2ac2618a86fe1b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Creating volume 4a18b3ef-a923-4f3b-b460-a6f159c2e737 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:18 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 1073741824 Nov 03 13:00:18 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:18 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 1073741824" returned: 0 in 0.670s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:18 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 Nov 03 13:00:18 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:19 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737" returned: 0 in 0.339s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cf22dc-b503-4ed1-b13b-42f7229fee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acb6a0f-de00-44ea-b4f3-5f425cd8b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Volume volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 (4a18b3ef-a923-4f3b-b460-a6f159c2e737): created successfully Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acb6a0f-de00-44ea-b4f3-5f425cd8b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Flow 'volume_create_manager' (765111bc-ff31-4d05-9d21-35a425916cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-27488adb-caa0-4e12-8e96-caf527706fb7 tempest-AttachVolumeTestJSON-1648937044 None] Created volume successfully. Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Flow 'volume_create_manager' (eba6b55c-962c-4685-9873-b7c391c80134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bab98b-43a0-4e10-9f78-bc66b514d9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bab98b-43a0-4e10-9f78-bc66b514d9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1652347404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e327941962459dab1f78e47d7db282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:19Z,use_quota=True,user_id='7876e951ebe847f39fd6b5cc99f8dd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f374dbf-990c-4225-bf56-cd7de165e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f374dbf-990c-4225-bf56-cd7de165e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcae81a-f0a2-4d95-91a1-b92b1ef3eddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcae81a-f0a2-4d95-91a1-b92b1ef3eddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f', 'volume_name': 'volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40bdde1-ed9a-42c7-b1b1-3be684274a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40bdde1-ed9a-42c7-b1b1-3be684274a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126aa56f-d981-4cf4-916a-d7db6a1c02fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Volume 05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f', 'volume_size': 1} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1652347404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e327941962459dab1f78e47d7db282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:19Z,use_quota=True,user_id='7876e951ebe847f39fd6b5cc99f8dd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Creating volume 05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:00:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:19 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f 1073741824 Nov 03 13:00:19 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:20 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f 1073741824" returned: 0 in 0.572s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:20 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f Nov 03 13:00:20 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:20 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126aa56f-d981-4cf4-916a-d7db6a1c02fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355c95a7-110e-4140-8bc6-d7747363c14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Volume volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f (05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f): created successfully Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355c95a7-110e-4140-8bc6-d7747363c14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Flow 'volume_create_manager' (eba6b55c-962c-4685-9873-b7c391c80134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-52902b42-7e0b-439a-8968-c8ac54167535 tempest-VolumesDeleteCascade-1351072564 None] Created volume successfully. Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-d48fa4ab-9625-453f-ae5f-e6b3c7f68488 req-8d39b7c2-29c8-4a92-8c43-2576ae3ba095 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-d48fa4ab-9625-453f-ae5f-e6b3c7f68488 req-8d39b7c2-29c8-4a92-8c43-2576ae3ba095 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-d48fa4ab-9625-453f-ae5f-e6b3c7f68488 req-8d39b7c2-29c8-4a92-8c43-2576ae3ba095 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-d48fa4ab-9625-453f-ae5f-e6b3c7f68488 req-8d39b7c2-29c8-4a92-8c43-2576ae3ba095 tempest-AttachVolumeTestJSON-1648937044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1a52dff-db71-4a14-93c7-c4288ad32e83', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:00:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-d48fa4ab-9625-453f-ae5f-e6b3c7f68488 req-8d39b7c2-29c8-4a92-8c43-2576ae3ba095 tempest-AttachVolumeTestJSON-1648937044 None] attachment_update completed successfully. Nov 03 13:00:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Creating offline snapshot 79465bd3-54c5-4ee5-938c-c9cbe208a911 of volume 05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:00:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceba2f0-14b9-4f75-ab69-b9bd6f09863c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:22 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f Nov 03 13:00:22 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:22 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:22 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 1G Nov 03 13:00:22 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:22 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 1G" returned: 0 in 0.642s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:22 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 Nov 03 13:00:22 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:23 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911" returned: 0 in 0.444s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 is being set with open permissions: ugo+rw Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:23 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 Nov 03 13:00:23 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Flow 'volume_create_manager' (d63a9250-1097-4c46-92d0-17c3ee1f331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7cc331e-2bd8-4885-89dc-5398fa0e5a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7cc331e-2bd8-4885-89dc-5398fa0e5a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221256211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020cb66f-a701-41cb-b8e5-7174f9a1ab65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781e3a418ab64f2a8d92a0f5fbe2400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:23Z,use_quota=True,user_id='e1925633abe447d2ac2618a86fe1b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c97d7bf-bff9-42e3-bd58-c425a1058f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c97d7bf-bff9-42e3-bd58-c425a1058f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab415d88-6647-4065-9acf-87699d0a8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab415d88-6647-4065-9acf-87699d0a8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020cb66f-a701-41cb-b8e5-7174f9a1ab65', 'volume_name': 'volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1abf039-b60d-4c06-9cbd-9d4ca793fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1abf039-b60d-4c06-9cbd-9d4ca793fd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fc4101-a268-4189-9ed1-47c8ceea6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Volume 020cb66f-a701-41cb-b8e5-7174f9a1ab65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65', 'volume_size': 1} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:23 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911" returned: 0 in 0.367s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:23 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.info Nov 03 13:00:23 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:24 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.info" returned: 0 in 0.297s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:24 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.info is being set with open permissions: ugo+rw Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:24 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.info Nov 03 13:00:24 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:24 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.info" returned: 0 in 0.286s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221256211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020cb66f-a701-41cb-b8e5-7174f9a1ab65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781e3a418ab64f2a8d92a0f5fbe2400a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:23Z,use_quota=True,user_id='e1925633abe447d2ac2618a86fe1b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Creating volume 020cb66f-a701-41cb-b8e5-7174f9a1ab65 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:24 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:24 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 1073741824 Nov 03 13:00:24 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c2f49e0b-1dec-4d9c-8343-304c79779c34 tempest-VolumesDeleteCascade-1351072564 None] Create snapshot completed successfully Nov 03 13:00:24 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 1073741824" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:25 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 Nov 03 13:00:25 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:25 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fc4101-a268-4189-9ed1-47c8ceea6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534a21e1-7fed-404a-b152-1e459ddb66e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Volume volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 (020cb66f-a701-41cb-b8e5-7174f9a1ab65): created successfully Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534a21e1-7fed-404a-b152-1e459ddb66e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Flow 'volume_create_manager' (d63a9250-1097-4c46-92d0-17c3ee1f331b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a76f2cd1-3def-4bcd-971c-f5b5a10aa37d tempest-AttachVolumeTestJSON-1648937044 None] Created volume successfully. Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Flow 'volume_create_manager' (db28a093-b11e-4e6a-96f7-473a537e4433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b599938-f2e6-4483-b1b8-3a9ec996b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b599938-f2e6-4483-b1b8-3a9ec996b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1617506122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d90998-35c9-4d1a-ad75-38798e36594c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e327941962459dab1f78e47d7db282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79465bd3-54c5-4ee5-938c-c9cbe208a911,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:26Z,use_quota=True,user_id='7876e951ebe847f39fd6b5cc99f8dd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92f295a-94ba-4075-860a-ac256f08fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92f295a-94ba-4075-860a-ac256f08fd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4c9839-bc93-436f-bb21-304f4975bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4c9839-bc93-436f-bb21-304f4975bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7d90998-35c9-4d1a-ad75-38798e36594c', 'volume_name': 'volume-a7d90998-35c9-4d1a-ad75-38798e36594c', 'volume_size': 1, 'snapshot_id': '79465bd3-54c5-4ee5-938c-c9cbe208a911'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd428c67-cc0f-45c4-96a0-bd35704ab891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd428c67-cc0f-45c4-96a0-bd35704ab891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1096dad-ccaf-42aa-819f-e467d0fb4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Volume a7d90998-35c9-4d1a-ad75-38798e36594c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7d90998-35c9-4d1a-ad75-38798e36594c', 'volume_size': 1, 'snapshot_id': '79465bd3-54c5-4ee5-938c-c9cbe208a911'} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-79465bd3-54c5-4ee5-938c-c9cbe208a911-a7d90998-35c9-4d1a-ad75-38798e36594c" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-79465bd3-54c5-4ee5-938c-c9cbe208a911-a7d90998-35c9-4d1a-ad75-38798e36594c" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Creating volume a7d90998-35c9-4d1a-ad75-38798e36594c from snapshot 79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-a7d90998-35c9-4d1a-ad75-38798e36594c" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-a7d90998-35c9-4d1a-ad75-38798e36594c" acquired by "_copy_volume_from_snapshot" :: waited 0.078s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] snapshot: 79465bd3-54c5-4ee5-938c-c9cbe208a911, volume: a7d90998-35c9-4d1a-ad75-38798e36594c, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[896ede8f-9fae-47b6-9f61-e9c0ae79f952]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:26 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 Nov 03 13:00:26 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Flow 'volume_create_manager' (ddb91941-2b7e-4e96-a270-2380bc1590b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284e663b-85bf-4ae2-b9a8-250825dc1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284e663b-85bf-4ae2-b9a8-250825dc1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-693755573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240c8245-f39d-423b-ad76-33b098567b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26a8a2aedc24c439ebaa5040c7e7a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:26Z,use_quota=True,user_id='30f1a0974acb4ace887a36ddbc96e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb1be8-d919-48a3-88a9-7240fa5037d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb1be8-d919-48a3-88a9-7240fa5037d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f13937-2a0c-4dcd-a633-25a764fffdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f13937-2a0c-4dcd-a633-25a764fffdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240c8245-f39d-423b-ad76-33b098567b85', 'volume_name': 'volume-240c8245-f39d-423b-ad76-33b098567b85', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935087b7-4505-454d-8df3-ef5f184aaf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935087b7-4505-454d-8df3-ef5f184aaf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7626b14-f727-41c1-84d7-cff756a1c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Volume 240c8245-f39d-423b-ad76-33b098567b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240c8245-f39d-423b-ad76-33b098567b85', 'volume_size': 1} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-791340f6-9c10-42dd-977e-d696cf9e3e2e req-3c4b2c74-dc25-402c-ab78-fca2c12358fd tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:26 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5deb55-1c96-449d-a9a7-79bc20592bbb]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:26 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f Nov 03 13:00:26 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:26 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:00:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:26 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c Nov 03 13:00:26 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:34 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c" returned: 0 in 7.524s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:00:34 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Converted 1024.00 MB image at 136.08 MB/s Nov 03 13:00:34 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c is being set with open permissions: ugo+rw Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:34 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c Nov 03 13:00:34 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:34 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c" returned: 0 in 0.286s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-a7d90998-35c9-4d1a-ad75-38798e36594c" released by "_copy_volume_from_snapshot" :: held 8.834s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-79465bd3-54c5-4ee5-938c-c9cbe208a911-a7d90998-35c9-4d1a-ad75-38798e36594c" released by "_create_volume_from_snapshot" :: held 9.003s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.046s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.534s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-693755573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240c8245-f39d-423b-ad76-33b098567b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26a8a2aedc24c439ebaa5040c7e7a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:26Z,use_quota=True,user_id='30f1a0974acb4ace887a36ddbc96e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Creating volume 240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:34 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 1073741824 Nov 03 13:00:34 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1096dad-ccaf-42aa-819f-e467d0fb4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d90998-35c9-4d1a-ad75-38798e36594c', 'volume_size': 1, 'snapshot_id': '79465bd3-54c5-4ee5-938c-c9cbe208a911'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d859e68c-1aab-4ccf-84e4-1447ef3ccfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Volume volume-a7d90998-35c9-4d1a-ad75-38798e36594c (a7d90998-35c9-4d1a-ad75-38798e36594c): created successfully Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d859e68c-1aab-4ccf-84e4-1447ef3ccfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Flow 'volume_create_manager' (db28a093-b11e-4e6a-96f7-473a537e4433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e1f2b043-24af-47fc-8d1b-641ebab99f3b tempest-VolumesDeleteCascade-1351072564 None] Created volume successfully. Nov 03 13:00:35 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 1073741824" returned: 0 in 0.518s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:35 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 Nov 03 13:00:35 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Performing cascade delete. {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-79465bd3-54c5-4ee5-938c-c9cbe208a911-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-79465bd3-54c5-4ee5-938c-c9cbe208a911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-79465bd3-54c5-4ee5-938c-c9cbe208a911" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-79465bd3-54c5-4ee5-938c-c9cbe208a911" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Deleting offline snapshot 79465bd3-54c5-4ee5-938c-c9cbe208a911 of volume 05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] snapshot_file for this snap is: volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3901eae3-6d0f-44f4-9f74-f88bbe2ca3d8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:35 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-791340f6-9c10-42dd-977e-d696cf9e3e2e req-3c4b2c74-dc25-402c-ab78-fca2c12358fd tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.224s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7626b14-f727-41c1-84d7-cff756a1c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240c8245-f39d-423b-ad76-33b098567b85', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d197a7e-4026-441d-9da0-10c2793073cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-791340f6-9c10-42dd-977e-d696cf9e3e2e req-3c4b2c74-dc25-402c-ab78-fca2c12358fd tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Volume volume-240c8245-f39d-423b-ad76-33b098567b85 (240c8245-f39d-423b-ad76-33b098567b85): created successfully Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d197a7e-4026-441d-9da0-10c2793073cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Flow 'volume_create_manager' (ddb91941-2b7e-4e96-a270-2380bc1590b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:35 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 Nov 03 13:00:35 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d056f3fd-6f1a-4c2b-89a7-29b51ea0b9f9 tempest-SnapshotMetadataTestJSON-2112768318 None] Created volume successfully. Nov 03 13:00:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-791340f6-9c10-42dd-977e-d696cf9e3e2e req-3c4b2c74-dc25-402c-ab78-fca2c12358fd tempest-AttachVolumeTestJSON-1648937044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1603ed3-0a5f-4c91-bff5-717701b191de', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:00:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-791340f6-9c10-42dd-977e-d696cf9e3e2e req-3c4b2c74-dc25-402c-ab78-fca2c12358fd tempest-AttachVolumeTestJSON-1648937044 None] attachment_update completed successfully. Nov 03 13:00:36 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911" returned: 0 in 0.512s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a1fa55-6016-4910-bd9e-41cd9d08b79f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Creating offline snapshot 812549b4-9f33-47f5-9dc5-de0887eb4fb6 of volume 240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a2069-aa7a-4b9f-a377-ad60418b9ce7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:36 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f Nov 03 13:00:36 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:36 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 Nov 03 13:00:36 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:36 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:36 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 1G Nov 03 13:00:36 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:36 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" returned: 0 in 0.658s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:36 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 Nov 03 13:00:36 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:37 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 1G" returned: 0 in 0.571s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240c8245-f39d-423b-ad76-33b098567b85 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240c8245-f39d-423b-ad76-33b098567b85 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 Nov 03 13:00:37 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:37 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911" returned: 0 in 0.619s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911 Nov 03 13:00:37 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:37 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240c8245-f39d-423b-ad76-33b098567b85 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 is being set with open permissions: ugo+rw Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:37 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 Nov 03 13:00:37 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:37 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f.79465bd3-54c5-4ee5-938c-c9cbe208a911" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-79465bd3-54c5-4ee5-938c-c9cbe208a911" released by "_delete_snapshot" :: held 2.340s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" released by "delete_snapshot" :: held 2.370s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Created reservations ['07b0f7bf-8815-45b8-8e15-fa84e48fe7d7', '098b4bc1-207f-4ec7-82a1-c8d1ed7b297e', '2c0e133f-596f-4d3d-8336-ce4adf79c0d4', '362b2481-9a96-46fb-b6fc-155b26a7012b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Delete snapshot completed successfully. Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-79465bd3-54c5-4ee5-938c-c9cbe208a911-delete_snapshot" released by "delete_snapshot" :: held 2.684s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Snapshots deleted, issuing volume delete {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:38 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6" returned: 0 in 0.494s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9282e3-29e7-40bd-ad31-9481de7c2852]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.info Nov 03 13:00:38 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:38 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f Nov 03 13:00:38 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:38 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.info" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.info is being set with open permissions: ugo+rw Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.info Nov 03 13:00:38 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-f353d49f-31b6-4837-83b9-eaead64018de req-1d6cfdd8-d2c0-4c84-98e6-606912b9673c tempest-AttachVolumeTestJSON-1648937044 None] Terminate volume connection completed successfully. Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-f353d49f-31b6-4837-83b9-eaead64018de req-1d6cfdd8-d2c0-4c84-98e6-606912b9673c tempest-AttachVolumeTestJSON-1648937044 None] Deleting attachment e1a52dff-db71-4a14-93c7-c4288ad32e83. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:00:38 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" returned: 0 in 0.583s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:38 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f Nov 03 13:00:38 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:39 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.info" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fa6a51fb-ed1e-457a-97ba-214a142319e2 tempest-SnapshotMetadataTestJSON-2112768318 None] Create snapshot completed successfully Nov 03 13:00:39 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f" released by "delete_volume" :: held 0.933s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Created reservations ['b1d77289-29d6-4b5a-998b-65596d55abdd', 'e35efde7-99eb-45d5-a5b3-026f7b721333', '6c7f3a45-92ac-41b8-80a1-cadbaab7edb2', 'b69a7ef9-34b1-4277-9308-23f68bf19bf5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:39 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:39 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:39 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.308s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Deleted volume successfully. Nov 03 13:00:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-40956a68-c4a7-4789-a782-aa3965999b06 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-05e7f4b1-a89b-465c-b4b3-4c59f2a9b88f-delete_volume" released by "delete_volume" :: held 4.233s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-a7d90998-35c9-4d1a-ad75-38798e36594c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-a7d90998-35c9-4d1a-ad75-38798e36594c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "cinder-quobyte-a7d90998-35c9-4d1a-ad75-38798e36594c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-a7d90998-35c9-4d1a-ad75-38798e36594c" acquired by "delete_volume" :: waited 0.049s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c68f2256-609f-413e-b28c-9106a24c457a req-35454c55-b6a2-493e-b338-70f1bf6859c1 tempest-AttachVolumeTestJSON-1648937044 None] Terminate volume connection completed successfully. Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c68f2256-609f-413e-b28c-9106a24c457a req-35454c55-b6a2-493e-b338-70f1bf6859c1 tempest-AttachVolumeTestJSON-1648937044 None] Deleting attachment e1603ed3-0a5f-4c91-bff5-717701b191de. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9492a48a-19fd-47ad-a5f8-92dff975ef17]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:40 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c Nov 03 13:00:40 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "cinder-812549b4-9f33-47f5-9dc5-de0887eb4fb6-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-812549b4-9f33-47f5-9dc5-de0887eb4fb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "cinder-quobyte-240c8245-f39d-423b-ad76-33b098567b85" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-quobyte-240c8245-f39d-423b-ad76-33b098567b85" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "cinder-quobyte-812549b4-9f33-47f5-9dc5-de0887eb4fb6" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-quobyte-812549b4-9f33-47f5-9dc5-de0887eb4fb6" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Deleting offline snapshot 812549b4-9f33-47f5-9dc5-de0887eb4fb6 of volume 240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] snapshot_file for this snap is: volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3f8551-4b55-41a7-acab-3742e286ccd6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c" returned: 0 in 0.564s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c Nov 03 13:00:41 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:41 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 Nov 03 13:00:41 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:41 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a7d90998-35c9-4d1a-ad75-38798e36594c" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-quobyte-a7d90998-35c9-4d1a-ad75-38798e36594c" released by "delete_volume" :: held 1.033s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:41 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6" returned: 0 in 0.441s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240c8245-f39d-423b-ad76-33b098567b85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9a216e-09e9-4a0e-a521-1ae1d50d8f66]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Created reservations ['265f3b4c-b851-42d4-9fef-af7393f75746', '02f260ea-1b1e-414a-b760-2a71ad4aaa12', '5691a2e7-d13b-4f68-b4dd-3c7beb346e3d', 'e7505687-942f-450a-a636-8b5398edcba5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:41 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 Nov 03 13:00:41 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:41 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:41 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:42 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85" returned: 0 in 0.607s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:42 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.371s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:42 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 Nov 03 13:00:42 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Deleted volume successfully. Nov 03 13:00:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-025d6e9a-a735-4980-9521-43234cb5ff27 tempest-VolumesDeleteCascade-1351072564 None] Lock "cinder-a7d90998-35c9-4d1a-ad75-38798e36594c-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:42 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6" returned: 0 in 0.625s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:42 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6 Nov 03 13:00:42 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:43 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85.812549b4-9f33-47f5-9dc5-de0887eb4fb6" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-quobyte-812549b4-9f33-47f5-9dc5-de0887eb4fb6" released by "_delete_snapshot" :: held 2.207s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-quobyte-240c8245-f39d-423b-ad76-33b098567b85" released by "delete_snapshot" :: held 2.254s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Created reservations ['0a18e15b-fee2-4d35-9cc5-061862200b79', '082ce6a9-cef1-4317-9d1f-73eb6cd0329c', 'dcb33209-5de6-4491-85de-42f64613debe', '35bcc6a3-2724-46b7-8615-352ffaa96d59'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Delete snapshot completed successfully. Nov 03 13:00:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0ddcb0da-9a65-47ab-9c22-404c8a2ad1c9 tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-812549b4-9f33-47f5-9dc5-de0887eb4fb6-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "cinder-240c8245-f39d-423b-ad76-33b098567b85-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-240c8245-f39d-423b-ad76-33b098567b85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "cinder-quobyte-240c8245-f39d-423b-ad76-33b098567b85" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-quobyte-240c8245-f39d-423b-ad76-33b098567b85" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[01732a1c-603a-400e-9b4c-4bf693a5c2ad]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:44 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 Nov 03 13:00:44 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:45 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85" returned: 0 in 0.661s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:45 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85 Nov 03 13:00:45 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:45 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-240c8245-f39d-423b-ad76-33b098567b85" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-quobyte-240c8245-f39d-423b-ad76-33b098567b85" released by "delete_volume" :: held 1.160s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Created reservations ['01cb6656-fca7-46f7-8f92-653d9adb27c0', 'b23967e1-42d2-4cbc-bec0-1b32fbfc23a5', '24456fdd-46ed-4016-8bc7-b2efe635eef6', '60c86697-bc92-489f-a7b8-f7a67ee780f8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:45 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:45 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:46 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:46 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Deleted volume successfully. Nov 03 13:00:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0358a68-cf5d-4d48-bb27-792a568ecabd tempest-SnapshotMetadataTestJSON-2112768318 None] Lock "cinder-240c8245-f39d-423b-ad76-33b098567b85-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "cinder-020cb66f-a701-41cb-b8e5-7174f9a1ab65-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-020cb66f-a701-41cb-b8e5-7174f9a1ab65-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "cinder-quobyte-020cb66f-a701-41cb-b8e5-7174f9a1ab65" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-quobyte-020cb66f-a701-41cb-b8e5-7174f9a1ab65" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:47 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad48c50-db80-46aa-8cd4-060e9fcc0cf2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:47 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 Nov 03 13:00:47 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:48 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:48 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65 Nov 03 13:00:48 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:48 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-020cb66f-a701-41cb-b8e5-7174f9a1ab65" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-quobyte-020cb66f-a701-41cb-b8e5-7174f9a1ab65" released by "delete_volume" :: held 0.827s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=103,cinder:UPDATE=106,cinder:INSERT=25,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Created reservations ['842406c2-e6a2-4790-871b-8ad0bb8b0dfd', '2c610a58-596c-4834-b86a-78972f6a65a1', '1650c9f0-0325-4565-8b42-648814b9bbc4', '671d0761-7fef-4243-b905-0a3c7a698466'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=106,cinder:UPDATE=112,cinder:INSERT=33,cinder:DELETE=10 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:48 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:48 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "cinder-4a18b3ef-a923-4f3b-b460-a6f159c2e737-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-4a18b3ef-a923-4f3b-b460-a6f159c2e737-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "cinder-quobyte-4a18b3ef-a923-4f3b-b460-a6f159c2e737" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-quobyte-4a18b3ef-a923-4f3b-b460-a6f159c2e737" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3bccc5-b5fc-4e66-bf1d-d6337fc82c59]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:49 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.476s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Deleted volume successfully. Nov 03 13:00:49 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3836de9d-7b04-4e86-80c6-3bc1014eb499 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-020cb66f-a701-41cb-b8e5-7174f9a1ab65-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:49 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:49 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Flow 'volume_create_manager' (a9f12b1e-43cd-44e2-b94f-0a635a857de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc3522b-932e-4f22-8c80-2ede298a3370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc3522b-932e-4f22-8c80-2ede298a3370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1261597135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86697d90-bfdf-44fb-8a7d-f2e8092f2210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24084940404713bf03ea68d42c0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:49Z,use_quota=True,user_id='0f539f41b67f45dc8479c2965283bb8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:49 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737 Nov 03 13:00:49 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b94642e-c65f-4e8a-84bf-1efb9b4774e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b94642e-c65f-4e8a-84bf-1efb9b4774e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be86b58-ae45-4331-ac4f-3c6d4f9ed94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be86b58-ae45-4331-ac4f-3c6d4f9ed94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86697d90-bfdf-44fb-8a7d-f2e8092f2210', 'volume_name': 'volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2760153f-90eb-49da-8d7b-dd6b1ce3760f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2760153f-90eb-49da-8d7b-dd6b1ce3760f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d450d36-08c1-478e-988d-ca121a7a4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Volume 86697d90-bfdf-44fb-8a7d-f2e8092f2210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210', 'volume_size': 1} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1261597135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86697d90-bfdf-44fb-8a7d-f2e8092f2210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf24084940404713bf03ea68d42c0529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:49Z,use_quota=True,user_id='0f539f41b67f45dc8479c2965283bb8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Creating volume 86697d90-bfdf-44fb-8a7d-f2e8092f2210 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:49 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:49 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 1073741824 Nov 03 13:00:49 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:49 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4a18b3ef-a923-4f3b-b460-a6f159c2e737" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-quobyte-4a18b3ef-a923-4f3b-b460-a6f159c2e737" released by "delete_volume" :: held 0.972s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:49 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Created reservations ['9269a33a-5320-4449-ad64-3c7d5c213e80', 'd1c22105-fa32-40a0-a91b-b40035a50f1d', 'ddda1e2b-1b29-4a4f-ac5d-8c9ba219358d', '0b9c290c-deb8-4f15-84b9-94fc3085f4a8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:50 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:50 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:50 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 1073741824" returned: 0 in 0.579s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:50 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 Nov 03 13:00:50 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:50 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Deleted volume successfully. Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b9408d5-1d06-4c09-9901-eed896b21076 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-4a18b3ef-a923-4f3b-b460-a6f159c2e737-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:50 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210" returned: 0 in 0.352s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d450d36-08c1-478e-988d-ca121a7a4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42343ad3-9665-480a-bb88-ff29358cfb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Volume volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 (86697d90-bfdf-44fb-8a7d-f2e8092f2210): created successfully Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42343ad3-9665-480a-bb88-ff29358cfb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Flow 'volume_create_manager' (a9f12b1e-43cd-44e2-b94f-0a635a857de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-74d46d31-9c39-4451-a8e6-13d3b9ce6d30 tempest-VolumesMetadataTest-137094952 None] Created volume successfully. Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "cinder-7e9eccc3-55d6-4f02-8535-3b5dadaa206a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-7e9eccc3-55d6-4f02-8535-3b5dadaa206a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "cinder-quobyte-7e9eccc3-55d6-4f02-8535-3b5dadaa206a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-quobyte-7e9eccc3-55d6-4f02-8535-3b5dadaa206a" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2353b3d-6356-4825-a891-4904262fad24]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:51 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a Nov 03 13:00:51 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:51 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a" returned: 0 in 0.576s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:51 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a Nov 03 13:00:51 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:52 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7e9eccc3-55d6-4f02-8535-3b5dadaa206a" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-quobyte-7e9eccc3-55d6-4f02-8535-3b5dadaa206a" released by "delete_volume" :: held 1.039s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Created reservations ['fb398fe9-600b-405b-9aeb-a64a84b74874', 'b367334c-6ad5-4e67-b7db-a3664e7f203b', 'c3b0cfac-ac13-4332-82f8-fbff28bf4b9c', 'c2188165-f0ca-4901-8452-5c17126ec461'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:52 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:52 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:52 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Deleted volume successfully. Nov 03 13:00:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c507bd4-b897-42ea-9917-bb8998ed3c85 tempest-AttachVolumeTestJSON-1648937044 None] Lock "cinder-7e9eccc3-55d6-4f02-8535-3b5dadaa206a-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Acquiring lock "cinder-86697d90-bfdf-44fb-8a7d-f2e8092f2210-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Lock "cinder-86697d90-bfdf-44fb-8a7d-f2e8092f2210-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Acquiring lock "cinder-quobyte-86697d90-bfdf-44fb-8a7d-f2e8092f2210" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Lock "cinder-quobyte-86697d90-bfdf-44fb-8a7d-f2e8092f2210" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[371792af-dd00-4764-aa81-63eab7023ad9]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:53 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 Nov 03 13:00:53 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:53 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210" returned: 0 in 0.513s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:53 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210 Nov 03 13:00:53 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:54 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-86697d90-bfdf-44fb-8a7d-f2e8092f2210" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Lock "cinder-quobyte-86697d90-bfdf-44fb-8a7d-f2e8092f2210" released by "delete_volume" :: held 0.900s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Flow 'volume_create_manager' (a1a4dea7-1509-4448-ad9e-070200bc9b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58b194b-2b16-42a0-a02c-3091b82c1f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Created reservations ['67726336-a15d-4354-b273-a8aff2521011', '494e2bb6-9069-4b7b-b6e9-85faa47393ef', 'ae5a31ff-2f05-42d3-8293-e8dc009a5b3d', '7b2cd217-8de2-49f4-ac9c-36a0f4e8f69d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58b194b-2b16-42a0-a02c-3091b82c1f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-963646444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4363f587-2f83-42a4-83b0-68b48fe46db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92557dd2d94e41c984e9535181ff6e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:54Z,use_quota=True,user_id='868df976981940a6b2b31bee751fbd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e6179-daed-4e40-816c-2a2127dc9cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e6179-daed-4e40-816c-2a2127dc9cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e64be6-670f-4090-8a1f-97253644955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e64be6-670f-4090-8a1f-97253644955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4363f587-2f83-42a4-83b0-68b48fe46db2', 'volume_name': 'volume-4363f587-2f83-42a4-83b0-68b48fe46db2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd183c41-d718-43fb-8f94-076eca0539c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd183c41-d718-43fb-8f94-076eca0539c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b82cd8-cb8c-453d-8f62-3e2953bd4612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Volume 4363f587-2f83-42a4-83b0-68b48fe46db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4363f587-2f83-42a4-83b0-68b48fe46db2', 'volume_size': 1} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-963646444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4363f587-2f83-42a4-83b0-68b48fe46db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92557dd2d94e41c984e9535181ff6e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:00:54Z,use_quota=True,user_id='868df976981940a6b2b31bee751fbd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Creating volume 4363f587-2f83-42a4-83b0-68b48fe46db2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:00:54 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:54 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 1073741824 Nov 03 13:00:54 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:54 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:54 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:54 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Deleted volume successfully. Nov 03 13:00:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ffa1fa-6261-477c-8b3d-e5d486ac73d1 tempest-VolumesMetadataTest-137094952 None] Lock "cinder-86697d90-bfdf-44fb-8a7d-f2e8092f2210-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:00:55 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 1073741824" returned: 0 in 0.691s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:55 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 Nov 03 13:00:55 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:55 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2" returned: 0 in 0.525s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b82cd8-cb8c-453d-8f62-3e2953bd4612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4363f587-2f83-42a4-83b0-68b48fe46db2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89d85aa-d79c-4c3b-b736-5a179782cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:00:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Volume volume-4363f587-2f83-42a4-83b0-68b48fe46db2 (4363f587-2f83-42a4-83b0-68b48fe46db2): created successfully Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89d85aa-d79c-4c3b-b736-5a179782cd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:00:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Flow 'volume_create_manager' (a1a4dea7-1509-4448-ad9e-070200bc9b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:00:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4eb66dd8-2132-4ed9-8f16-fb6c87380926 tempest-VolumesTransfersTest-1093870793 None] Created volume successfully. Nov 03 13:00:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-eb07e49a-4ece-4dde-8637-634ec233aac7 tempest-VolumesTransfersTest-816771580 None] Transfer volume completed successfully. Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:58 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:00:58 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Acquiring lock "cinder-4363f587-2f83-42a4-83b0-68b48fe46db2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-4363f587-2f83-42a4-83b0-68b48fe46db2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Acquiring lock "cinder-quobyte-4363f587-2f83-42a4-83b0-68b48fe46db2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-quobyte-4363f587-2f83-42a4-83b0-68b48fe46db2" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:00:59 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.489s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dba866-e971-4af4-aa29-d377fb1012dc]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:59 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 Nov 03 13:00:59 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:00:59 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2" returned: 0 in 0.721s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:00:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:00:59 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2 Nov 03 13:00:59 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:00 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4363f587-2f83-42a4-83b0-68b48fe46db2" returned: 0 in 0.325s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-quobyte-4363f587-2f83-42a4-83b0-68b48fe46db2" released by "delete_volume" :: held 1.129s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Created reservations ['6a49f69b-9bf3-4e84-bd64-ab178449c0a4', '3fb94d13-f327-44f4-9804-2c4b9b2b9161', '362bb4e9-0578-415b-95e3-7c122f8d5625', '6bd0eb07-9b18-4ffc-85e0-5cabce39d0ae'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:00 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:01:00 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:00 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:00 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:01:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Deleted volume successfully. Nov 03 13:01:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bcfad95-0e0d-412f-baee-f79c82d18f8a tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-4363f587-2f83-42a4-83b0-68b48fe46db2-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Flow 'volume_create_manager' (bf4258f1-16e9-4a20-a280-fe70b86716df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601a9093-15d1-4c5d-870b-a45c55f8a150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601a9093-15d1-4c5d-870b-a45c55f8a150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1017816211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a333ab8-2ebb-41c7-a503-08a8e4f8f528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92557dd2d94e41c984e9535181ff6e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:02Z,use_quota=True,user_id='868df976981940a6b2b31bee751fbd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bcd803-f2ac-4d67-ab54-ce9a897702fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bcd803-f2ac-4d67-ab54-ce9a897702fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de25e6e5-6aff-4eee-a0db-e5dacccea028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de25e6e5-6aff-4eee-a0db-e5dacccea028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a333ab8-2ebb-41c7-a503-08a8e4f8f528', 'volume_name': 'volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f3d483-453d-4c07-bef2-29955a24764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f3d483-453d-4c07-bef2-29955a24764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c11985b-c365-46b0-b4b0-64b3e9585f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Volume 5a333ab8-2ebb-41c7-a503-08a8e4f8f528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528', 'volume_size': 1} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1017816211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a333ab8-2ebb-41c7-a503-08a8e4f8f528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92557dd2d94e41c984e9535181ff6e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:02Z,use_quota=True,user_id='868df976981940a6b2b31bee751fbd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Creating volume 5a333ab8-2ebb-41c7-a503-08a8e4f8f528 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:02 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:02 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 1073741824 Nov 03 13:01:02 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:02 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 1073741824" returned: 0 in 0.603s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:03 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 Nov 03 13:01:03 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Flow 'volume_create_manager' (c71e1782-a433-48bb-ae2e-59f1e9df01ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4721b74a-b76d-4cc8-a5bd-a1571edfe395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4721b74a-b76d-4cc8-a5bd-a1571edfe395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-929802083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8516d8-4000-4da7-b8e4-3ecc9df84cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf285abe579486f878b8753cd9efe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:03Z,use_quota=True,user_id='ae8d790b25ac4ebbacd3545ce594e961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5a9c1a-3ead-4712-8604-2a5333a1e195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5a9c1a-3ead-4712-8604-2a5333a1e195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b345b3aa-03df-4055-aaaf-ae7440447d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b345b3aa-03df-4055-aaaf-ae7440447d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8516d8-4000-4da7-b8e4-3ecc9df84cca', 'volume_name': 'volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a355657e-4dc7-411e-b1e1-af39fb15db87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a355657e-4dc7-411e-b1e1-af39fb15db87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f96afd-9bce-4046-9fff-7ab108816e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Volume 2a8516d8-4000-4da7-b8e4-3ecc9df84cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca', 'volume_size': 2} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:03 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-929802083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8516d8-4000-4da7-b8e4-3ecc9df84cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf285abe579486f878b8753cd9efe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:03Z,use_quota=True,user_id='ae8d790b25ac4ebbacd3545ce594e961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Creating volume 2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca 2147483648 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c11985b-c365-46b0-b4b0-64b3e9585f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:03 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca 2147483648 Nov 03 13:01:03 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9a3a1d-39d2-410c-b41a-2fb856115ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Volume volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 (5a333ab8-2ebb-41c7-a503-08a8e4f8f528): created successfully Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9a3a1d-39d2-410c-b41a-2fb856115ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Flow 'volume_create_manager' (bf4258f1-16e9-4a20-a280-fe70b86716df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-234f15b0-fe09-4e15-9384-54d48446c4d9 tempest-VolumesTransfersTest-1093870793 None] Created volume successfully. Nov 03 13:01:03 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca 2147483648" returned: 0 in 0.560s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:03 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca Nov 03 13:01:03 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:04 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f96afd-9bce-4046-9fff-7ab108816e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3c5dfb-5146-465b-8347-263a72417d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Volume volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca (2a8516d8-4000-4da7-b8e4-3ecc9df84cca): created successfully Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3c5dfb-5146-465b-8347-263a72417d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Flow 'volume_create_manager' (c71e1782-a433-48bb-ae2e-59f1e9df01ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3a18968d-c91f-4493-9ee0-192e060b49b4 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Created volume successfully. Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Acquiring lock "cinder-5a333ab8-2ebb-41c7-a503-08a8e4f8f528-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-5a333ab8-2ebb-41c7-a503-08a8e4f8f528-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Acquiring lock "cinder-quobyte-5a333ab8-2ebb-41c7-a503-08a8e4f8f528" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-quobyte-5a333ab8-2ebb-41c7-a503-08a8e4f8f528" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3a9d6d-666a-4ab9-ad98-826e72697a8c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:04 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 Nov 03 13:01:04 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:05 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:05 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528 Nov 03 13:01:05 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Creating offline snapshot 662b8095-da32-4c64-8d9e-745748e26824 of volume 2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[881a30a4-ef06-478e-9352-7284ab095b2a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:05 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca Nov 03 13:01:05 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:05 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a333ab8-2ebb-41c7-a503-08a8e4f8f528" returned: 0 in 0.412s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-quobyte-5a333ab8-2ebb-41c7-a503-08a8e4f8f528" released by "delete_volume" :: held 0.878s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Created reservations ['4bc863ad-1a78-4b88-806e-3c9a81bd97a3', 'f91fbada-78eb-4525-b123-48a77e5e966c', '133c83ab-b5cf-47a8-81a9-8ecc941052a9', 'ec205960-e40c-4b4c-b9b5-c1d1cccf2529'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:06 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:01:06 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:06 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" returned: 0 in 0.588s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 2G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:06 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 2G Nov 03 13:01:06 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:06 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:01:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Deleted volume successfully. Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a570b79e-6e2b-400f-834e-03443d6d4bd1 tempest-VolumesTransfersTest-1565708994 None] Lock "cinder-5a333ab8-2ebb-41c7-a503-08a8e4f8f528-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9e79103e-be90-4d49-9615-ebf4d2752e96 tempest-BackendsCapabilitiesAdminTestsJSON-1747460296 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7330017089844, 'free_capacity_gb': 1773.7330017089844, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-855f2b26-374d-4d03-9eeb-e8c8f56e6f8f tempest-BackendsCapabilitiesAdminTestsJSON-1747460296 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7330017089844, 'free_capacity_gb': 1773.7330017089844, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 13:01:06 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 2G" returned: 0 in 0.673s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:06 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 Nov 03 13:01:06 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:07 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:07 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 is being set with open permissions: ugo+rw Nov 03 13:01:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:07 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 Nov 03 13:01:07 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:07 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:07 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.info Nov 03 13:01:07 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:07 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.info" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:07 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.info is being set with open permissions: ugo+rw Nov 03 13:01:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:07 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.info Nov 03 13:01:07 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:08 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.info" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1845ceb0-24f8-4cf5-a5ac-a0f12a6e0e05 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Create snapshot completed successfully Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "cinder-662b8095-da32-4c64-8d9e-745748e26824-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-662b8095-da32-4c64-8d9e-745748e26824-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "cinder-quobyte-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-quobyte-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "cinder-quobyte-662b8095-da32-4c64-8d9e-745748e26824" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-quobyte-662b8095-da32-4c64-8d9e-745748e26824" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Deleting offline snapshot 662b8095-da32-4c64-8d9e-745748e26824 of volume 2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:01:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] snapshot_file for this snap is: volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:01:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aebcfe2-3bc5-4ab8-9f26-6e4117e740b2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:09 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 Nov 03 13:01:09 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:09 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824" returned: 0 in 0.517s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:01:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[92287242-443a-40cd-aebd-4ac6bebb53ad]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:09 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca Nov 03 13:01:09 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:10 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:10 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 Nov 03 13:01:10 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:10 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:10 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824 Nov 03 13:01:10 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:10 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca.662b8095-da32-4c64-8d9e-745748e26824" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-quobyte-662b8095-da32-4c64-8d9e-745748e26824" released by "_delete_snapshot" :: held 1.872s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-quobyte-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" released by "delete_snapshot" :: held 1.903s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Created reservations ['45f20062-b3a5-430f-be37-dfb63be671cf', '4e6914ac-2318-42a3-b40c-384139361a7f', '4616e756-bd05-4cca-a0e4-fe7b2d37929a', '58119dd7-8789-4ba4-ade3-931fba146f5b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Delete snapshot completed successfully. Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c36fdcf5-238f-4c99-9f60-c88bd9ac2f09 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-662b8095-da32-4c64-8d9e-745748e26824-delete_snapshot" released by "delete_snapshot" :: held 2.093s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "cinder-2a8516d8-4000-4da7-b8e4-3ecc9df84cca-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-2a8516d8-4000-4da7-b8e4-3ecc9df84cca-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "cinder-quobyte-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-quobyte-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7908a0d-c289-47e3-9e98-92556d4e0b4e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:11 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca Nov 03 13:01:11 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:11 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" returned: 0 in 0.482s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:11 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca Nov 03 13:01:11 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:12 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-quobyte-2a8516d8-4000-4da7-b8e4-3ecc9df84cca" released by "delete_volume" :: held 0.844s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Created reservations ['64e3e316-a1ac-4f04-8182-f40edc0b0a63', '372dbfdd-0d31-49be-a3ca-a6d6ced14b6a', 'b43a9bff-e8ba-4e32-96cb-a013e2368dbb', '04417f36-faa0-4b49-8328-71d12840481d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:12 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:01:12 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:12 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:01:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Deleted volume successfully. Nov 03 13:01:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-00d2b597-d584-4eaa-85e0-10718a2db139 tempest-VolumesSnapshotNegativeTestJSON-548023451 None] Lock "cinder-2a8516d8-4000-4da7-b8e4-3ecc9df84cca-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3531e608-3353-4e8f-b307-862b90c08212 tempest-GroupSnapshotsV319Test-150137802 None] Group tempest-GroupSnapshotsV319Test-Group-1506479613: creating Nov 03 13:01:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3531e608-3353-4e8f-b307-862b90c08212 tempest-GroupSnapshotsV319Test-150137802 None] Group tempest-GroupSnapshotsV319Test-Group-1506479613: created successfully Nov 03 13:01:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3531e608-3353-4e8f-b307-862b90c08212 tempest-GroupSnapshotsV319Test-150137802 None] Create group completed successfully. Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Flow 'volume_create_manager' (c3c6931d-b696-4035-ae7f-e77f62edc55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328d2ac9-4507-4d2d-b0c8-59ea00b02d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328d2ac9-4507-4d2d-b0c8-59ea00b02d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1435118003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d7b43d-3674-45c0-8123-13f9e918cf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b750bf9199490580e59dc12a14fb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:15Z,use_quota=True,user_id='bc4c2d915f6c4fc49dffe73476829585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c97a59-7f4d-4f10-a403-5b2ad99ede9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c97a59-7f4d-4f10-a403-5b2ad99ede9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0d6b8-ba97-4271-b79d-b9f0217013fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e0d6b8-ba97-4271-b79d-b9f0217013fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d7b43d-3674-45c0-8123-13f9e918cf05', 'volume_name': 'volume-e3d7b43d-3674-45c0-8123-13f9e918cf05', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611256aa-8fe1-4f0d-bf10-869747270735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611256aa-8fe1-4f0d-bf10-869747270735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2342b4-cd21-4704-b99d-cdce9d069930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Volume e3d7b43d-3674-45c0-8123-13f9e918cf05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d7b43d-3674-45c0-8123-13f9e918cf05', 'volume_size': 1} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1435118003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d7b43d-3674-45c0-8123-13f9e918cf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b750bf9199490580e59dc12a14fb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:15Z,use_quota=True,user_id='bc4c2d915f6c4fc49dffe73476829585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Creating volume e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:14 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 1073741824 Nov 03 13:01:14 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:15 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 1073741824" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:15 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 Nov 03 13:01:15 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:15 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2342b4-cd21-4704-b99d-cdce9d069930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d7b43d-3674-45c0-8123-13f9e918cf05', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8007fbf4-69d0-4cb8-a066-b3381d63c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Volume volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 (e3d7b43d-3674-45c0-8123-13f9e918cf05): created successfully Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8007fbf4-69d0-4cb8-a066-b3381d63c727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Flow 'volume_create_manager' (c3c6931d-b696-4035-ae7f-e77f62edc55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-174910e1-2239-4ad3-98c9-92854f3859df tempest-VolumesCloneTest-454340054 None] Created volume successfully. Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Flow 'volume_create_manager' (c266943f-3a4d-44d3-bed8-a6f4b641a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679eb5a-b2ca-4136-8400-c0457d839f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679eb5a-b2ca-4136-8400-c0457d839f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901977433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67bcbfbd-8a78-4419-a452-8d144dbadeae,host='devstack@QuobyteHD#QuobyteHD',id=4cf49a49-5a77-4181-9d59-9a2097b5e376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7128d6b982c4aa083c7480dbde079de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:16Z,use_quota=True,user_id='5e860ef5767b4124b986b5f0ddbaaa46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91b57234-b9cb-4e0e-bfeb-c068fb8b6dd9),volume_type_id=91b57234-b9cb-4e0e-bfeb-c068fb8b6dd9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea0a4df-8d55-4784-8530-539fb92bbca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea0a4df-8d55-4784-8530-539fb92bbca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca5ef76-57fb-41e0-8fe2-ee3f3ff21067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca5ef76-57fb-41e0-8fe2-ee3f3ff21067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf49a49-5a77-4181-9d59-9a2097b5e376', 'volume_name': 'volume-4cf49a49-5a77-4181-9d59-9a2097b5e376', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea32490-4250-4acd-b014-aa98a9f90fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea32490-4250-4acd-b014-aa98a9f90fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d53ac7-62bd-4ee4-90fe-304ef3e8aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Volume 4cf49a49-5a77-4181-9d59-9a2097b5e376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf49a49-5a77-4181-9d59-9a2097b5e376', 'volume_size': 1} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67bcbfbd-8a78-4419-a452-8d144dbadeae,created_at=2026-11-03T12:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1901977433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67bcbfbd-8a78-4419-a452-8d144dbadeae,host='devstack@QuobyteHD#QuobyteHD',id=4cf49a49-5a77-4181-9d59-9a2097b5e376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7128d6b982c4aa083c7480dbde079de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:16Z,use_quota=True,user_id='5e860ef5767b4124b986b5f0ddbaaa46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91b57234-b9cb-4e0e-bfeb-c068fb8b6dd9),volume_type_id=91b57234-b9cb-4e0e-bfeb-c068fb8b6dd9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Creating volume 4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:16 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 1073741824 Nov 03 13:01:16 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:17 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 1073741824" returned: 0 in 0.589s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:17 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 Nov 03 13:01:17 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:17 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d53ac7-62bd-4ee4-90fe-304ef3e8aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf49a49-5a77-4181-9d59-9a2097b5e376', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f75f4b-4810-4a70-9278-193cf274c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Volume volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 (4cf49a49-5a77-4181-9d59-9a2097b5e376): created successfully Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f75f4b-4810-4a70-9278-193cf274c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Flow 'volume_create_manager' (c266943f-3a4d-44d3-bed8-a6f4b641a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d92ced0c-924b-42ac-9cb8-f3a3df42c375 tempest-GroupSnapshotsV319Test-150137802 None] Created volume successfully. Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Flow 'volume_create_manager' (7277781d-07d5-4409-ac19-f364b67f7aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42226320-ff35-43b7-8508-060cce4e1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42226320-ff35-43b7-8508-060cce4e1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1551312978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d708e04-5a14-4e84-a7f7-5e405ba254fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b750bf9199490580e59dc12a14fb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e3d7b43d-3674-45c0-8123-13f9e918cf05,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:17Z,use_quota=True,user_id='bc4c2d915f6c4fc49dffe73476829585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d8e485-0ef4-4bfc-9a04-74bda480fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d8e485-0ef4-4bfc-9a04-74bda480fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ae7d70-f3a6-4131-8d3f-6b6d4612abd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ae7d70-f3a6-4131-8d3f-6b6d4612abd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3d708e04-5a14-4e84-a7f7-5e405ba254fe', 'volume_name': 'volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe', 'volume_size': 2, 'source_volid': 'e3d7b43d-3674-45c0-8123-13f9e918cf05', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e752371-c3f0-4a90-9a78-4c507628eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e752371-c3f0-4a90-9a78-4c507628eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5eef1b-086f-4254-a475-552cf79effd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Volume 3d708e04-5a14-4e84-a7f7-5e405ba254fe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe', 'volume_size': 2, 'source_volid': 'e3d7b43d-3674-45c0-8123-13f9e918cf05', 'source_volstatus': 'available'} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Cloning volume e3d7b43d-3674-45c0-8123-13f9e918cf05 to volume 3d708e04-5a14-4e84-a7f7-5e405ba254fe Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Creating offline snapshot 0d251bff-ec95-4d0d-9f31-8c7613aba689 of volume e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a01fff-daea-4e23-81de-3e1f261ac866]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:17 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 Nov 03 13:01:17 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:18 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05" returned: 0 in 0.376s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:18 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 1G Nov 03 13:01:18 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:18 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 1G" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:18 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 Nov 03 13:01:18 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:18 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689" returned: 0 in 0.323s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:18 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 is being set with open permissions: ugo+rw Nov 03 13:01:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:18 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 Nov 03 13:01:18 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] GroupSnapshot aaddf4e1-8770-4a54-94d0-ef6df2f4c384: creating. Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Group snapshot aaddf4e1-8770-4a54-94d0-ef6df2f4c384: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:19 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:19 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.info Nov 03 13:01:19 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:19 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.info" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:19 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.info is being set with open permissions: ugo+rw Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:19 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.info Nov 03 13:01:19 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:19 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.info" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Acquiring lock "cinder-quobyte-3d708e04-5a14-4e84-a7f7-5e405ba254fe" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-3d708e04-5a14-4e84-a7f7-5e405ba254fe" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] snapshot: 0d251bff-ec95-4d0d-9f31-8c7613aba689, volume: 3d708e04-5a14-4e84-a7f7-5e405ba254fe, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a751942-2144-4907-8198-4efe1c0417c1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:19 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 Nov 03 13:01:19 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:20 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3d7b43d-3674-45c0-8123-13f9e918cf05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea441a-670c-4609-a0ba-899c51f40d81]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:20 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 Nov 03 13:01:20 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:20 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05" returned: 0 in 0.423s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:01:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:20 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe Nov 03 13:01:20 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Flow 'volume_create_manager' (faccf26d-6c63-44dc-9749-1be1f7707ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b55453-ba87-4917-b166-b4b55f945ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b55453-ba87-4917-b166-b4b55f945ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-664597616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa8e8c3-d64f-41f1-830c-97d2285886a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d559683d1b3644c4ae68789801aed69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:21Z,use_quota=True,user_id='e4732bfcb5594cf993c82ff7ca130933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f3f446-f917-437b-97f8-aed6d5446991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f3f446-f917-437b-97f8-aed6d5446991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a405cb87-ccf8-4032-9112-97cd1eafdb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a405cb87-ccf8-4032-9112-97cd1eafdb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa8e8c3-d64f-41f1-830c-97d2285886a4', 'volume_name': 'volume-afa8e8c3-d64f-41f1-830c-97d2285886a4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cea0f3d-a39c-49cf-8565-50383c9f09b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cea0f3d-a39c-49cf-8565-50383c9f09b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dc5578-13a1-49e2-81cc-fa34c1bb25c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Volume afa8e8c3-d64f-41f1-830c-97d2285886a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa8e8c3-d64f-41f1-830c-97d2285886a4', 'volume_size': 1} Nov 03 13:01:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:28 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe" returned: 0 in 7.752s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:01:28 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Converted 1024.00 MB image at 132.08 MB/s Nov 03 13:01:28 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe is being set with open permissions: ugo+rw Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:28 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe Nov 03 13:01:28 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:28 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe" returned: 0 in 0.239s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-3d708e04-5a14-4e84-a7f7-5e405ba254fe" released by "_copy_volume_from_snapshot" :: held 8.887s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Acquiring lock "cinder-quobyte-0d251bff-ec95-4d0d-9f31-8c7613aba689" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-0d251bff-ec95-4d0d-9f31-8c7613aba689" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Deleting offline snapshot 0d251bff-ec95-4d0d-9f31-8c7613aba689 of volume e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] snapshot_file for this snap is: volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c0ae4d-42fa-455c-be4b-0a769e16046c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:28 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 Nov 03 13:01:28 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:29 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3d7b43d-3674-45c0-8123-13f9e918cf05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:01:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a557ba48-f950-4618-b814-e5a39c7c35b2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:29 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 Nov 03 13:01:29 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:29 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05" returned: 0 in 0.622s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:29 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 Nov 03 13:01:29 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:30 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:30 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689 Nov 03 13:01:30 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:30 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05.0d251bff-ec95-4d0d-9f31-8c7613aba689" returned: 0 in 0.243s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-0d251bff-ec95-4d0d-9f31-8c7613aba689" released by "_delete_snapshot" :: held 1.798s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.867s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.458s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Creating offline snapshot f14cb640-9de8-46f3-985d-5bff60dd0bae of volume 4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5eef1b-086f-4254-a475-552cf79effd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe', 'volume_size': 2, 'source_volid': 'e3d7b43d-3674-45c0-8123-13f9e918cf05', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20090dc-f1df-4bf1-a0d4-bbb0f80a4517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[717c0d52-d6ae-4aa9-9167-773053f4c18a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Volume volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe (3d708e04-5a14-4e84-a7f7-5e405ba254fe): created successfully Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20090dc-f1df-4bf1-a0d4-bbb0f80a4517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Flow 'volume_create_manager' (7277781d-07d5-4409-ac19-f364b67f7aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4e94526f-f07a-4942-8108-093d93ad2d90 tempest-VolumesCloneTest-454340054 None] Created volume successfully. Nov 03 13:01:30 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 Nov 03 13:01:30 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:31 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:31 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae 1G Nov 03 13:01:31 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:31 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae 1G" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:31 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae Nov 03 13:01:31 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae" returned: 0 in 0.314s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:31 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:01:31 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:31 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae Nov 03 13:01:31 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:32 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:32 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.info Nov 03 13:01:32 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Acquiring lock "cinder-3d708e04-5a14-4e84-a7f7-5e405ba254fe-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Lock "cinder-3d708e04-5a14-4e84-a7f7-5e405ba254fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Acquiring lock "cinder-quobyte-3d708e04-5a14-4e84-a7f7-5e405ba254fe" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-3d708e04-5a14-4e84-a7f7-5e405ba254fe" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[86411064-40dd-44d9-862a-201b38797309]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:32 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe Nov 03 13:01:32 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:32 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.info" returned: 0 in 0.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:32 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:32 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.info Nov 03 13:01:32 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:32 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:32 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.info" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:32 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe Nov 03 13:01:32 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.445s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-664597616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa8e8c3-d64f-41f1-830c-97d2285886a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d559683d1b3644c4ae68789801aed69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:21Z,use_quota=True,user_id='e4732bfcb5594cf993c82ff7ca130933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Creating volume afa8e8c3-d64f-41f1-830c-97d2285886a4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:32 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 1073741824 Nov 03 13:01:32 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-44f2234b-0e10-496a-ba5c-764435133709 tempest-GroupSnapshotsV319Test-150137802 None] group_snapshot aaddf4e1-8770-4a54-94d0-ef6df2f4c384: created successfully Nov 03 13:01:33 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3d708e04-5a14-4e84-a7f7-5e405ba254fe" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-3d708e04-5a14-4e84-a7f7-5e405ba254fe" released by "delete_volume" :: held 0.739s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Created reservations ['3b6dc5e7-fee6-41ca-a3d2-2300981a1b9b', '2f34ee72-a463-4e86-94f3-fb44213d18bc', '8eff068e-9fd0-4ede-960f-a9e63005c5b4', '35b66cda-5944-42a2-a2ae-3a95143a5c5f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:33 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:01:33 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:33 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 1073741824" returned: 0 in 0.627s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:33 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 Nov 03 13:01:33 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Acquiring lock "cinder-e3d7b43d-3674-45c0-8123-13f9e918cf05-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Lock "cinder-e3d7b43d-3674-45c0-8123-13f9e918cf05-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:33 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Acquiring lock "cinder-quobyte-e3d7b43d-3674-45c0-8123-13f9e918cf05" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Deleted volume successfully. Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-e3d7b43d-3674-45c0-8123-13f9e918cf05" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e32d002e-f64c-48e5-98e4-e3b2eb0193b9 tempest-VolumesCloneTest-454340054 None] Lock "cinder-3d708e04-5a14-4e84-a7f7-5e405ba254fe-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[55424577-9617-4197-a0c3-23c65f8cbaf6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:33 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4" returned: 0 in 0.341s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:33 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 Nov 03 13:01:33 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dc5578-13a1-49e2-81cc-fa34c1bb25c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa8e8c3-d64f-41f1-830c-97d2285886a4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d90843-3ef8-4edb-93af-334436b85f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Volume volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 (afa8e8c3-d64f-41f1-830c-97d2285886a4): created successfully Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d90843-3ef8-4edb-93af-334436b85f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Flow 'volume_create_manager' (faccf26d-6c63-44dc-9749-1be1f7707ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e773895b-b8a4-4e04-8765-99c2788a46b7 tempest-AttachVolumeNegativeTest-914678679 None] Created volume successfully. Nov 03 13:01:34 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:34 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05 Nov 03 13:01:34 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:34 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e3d7b43d-3674-45c0-8123-13f9e918cf05" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Lock "cinder-quobyte-e3d7b43d-3674-45c0-8123-13f9e918cf05" released by "delete_volume" :: held 0.858s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Created reservations ['ab642f29-7ecb-469a-b653-39f67541b49c', '57c9d5a3-6858-4031-8cec-ff6efbd7a28b', 'a228b44c-66d7-4bcf-873a-01d05c062c11', '3aa6be48-7b89-4d08-9d98-861597fa0b57'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] group_snapshot aaddf4e1-8770-4a54-94d0-ef6df2f4c384: deleting Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] group_snapshot aaddf4e1-8770-4a54-94d0-ef6df2f4c384: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Acquiring lock "cinder-quobyte-4cf49a49-5a77-4181-9d59-9a2097b5e376" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:34 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:01:34 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Lock "cinder-quobyte-4cf49a49-5a77-4181-9d59-9a2097b5e376" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Acquiring lock "cinder-quobyte-f14cb640-9de8-46f3-985d-5bff60dd0bae" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Lock "cinder-quobyte-f14cb640-9de8-46f3-985d-5bff60dd0bae" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Deleting offline snapshot f14cb640-9de8-46f3-985d-5bff60dd0bae of volume 4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] snapshot_file for this snap is: volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b199232-54db-49aa-b28d-d31748d022a4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:35 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae Nov 03 13:01:35 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:35 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.511s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:01:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Deleted volume successfully. Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19804116-b7a6-42f0-b1ef-4e393bb4a70f tempest-VolumesCloneTest-454340054 None] Lock "cinder-e3d7b43d-3674-45c0-8123-13f9e918cf05-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:35 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae" returned: 0 in 0.613s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf49a49-5a77-4181-9d59-9a2097b5e376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-19209c34-44d2-4e65-913d-52e52575a684 req-f9fff1ed-fd75-495a-90db-0d0ddd934c7d tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-19209c34-44d2-4e65-913d-52e52575a684 req-f9fff1ed-fd75-495a-90db-0d0ddd934c7d tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d107ed6d-81ea-44fc-a052-2e7dc27f66ee]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-19209c34-44d2-4e65-913d-52e52575a684 req-f9fff1ed-fd75-495a-90db-0d0ddd934c7d tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-19209c34-44d2-4e65-913d-52e52575a684 req-f9fff1ed-fd75-495a-90db-0d0ddd934c7d tempest-AttachVolumeNegativeTest-914678679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-afa8e8c3-d64f-41f1-830c-97d2285886a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ac4bbc6-dc28-4b2b-bae7-7a906a5a1040', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:01:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-19209c34-44d2-4e65-913d-52e52575a684 req-f9fff1ed-fd75-495a-90db-0d0ddd934c7d tempest-AttachVolumeNegativeTest-914678679 None] attachment_update completed successfully. Nov 03 13:01:35 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 Nov 03 13:01:35 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:36 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:36 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae Nov 03 13:01:36 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:36 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae" returned: 0 in 0.645s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:36 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae Nov 03 13:01:36 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:37 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376.f14cb640-9de8-46f3-985d-5bff60dd0bae" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Lock "cinder-quobyte-f14cb640-9de8-46f3-985d-5bff60dd0bae" released by "_delete_snapshot" :: held 2.350s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Lock "cinder-quobyte-4cf49a49-5a77-4181-9d59-9a2097b5e376" released by "delete_snapshot" :: held 2.398s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:37 devstack cinder-volume[86369]: WARNING cinder.quota [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-27642204 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-27642204, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:01:37 devstack cinder-volume[86369]: WARNING cinder.quota [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-27642204 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-27642204, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:01:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] Created reservations ['23541c7e-ffbf-491b-aca5-62f0247e262f', '2fcf88d7-7cd7-4f23-9a5c-83c971ada8b5', 'ce151194-c829-4679-a863-6687208606a4', 'b7d2b6f2-e93c-4bc4-9c20-657de6d844d7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e9d922c8-9a21-4957-9bf3-8a875745bda9 tempest-GroupSnapshotsV319Test-150137802 None] group_snapshot aaddf4e1-8770-4a54-94d0-ef6df2f4c384: deleted successfully Nov 03 13:01:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Acquiring lock "cinder-quobyte-4cf49a49-5a77-4181-9d59-9a2097b5e376" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:01:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Lock "cinder-quobyte-4cf49a49-5a77-4181-9d59-9a2097b5e376" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:01:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd9e9e9-1ac0-47c5-961c-ba82abb72a55]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:01:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:39 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 Nov 03 13:01:39 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:39 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376" returned: 0 in 0.837s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:39 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376 Nov 03 13:01:39 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:40 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4cf49a49-5a77-4181-9d59-9a2097b5e376" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Lock "cinder-quobyte-4cf49a49-5a77-4181-9d59-9a2097b5e376" released by "delete_volume" :: held 1.335s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Created reservations ['be8418b6-6aea-464b-aff8-9d93021cf79f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:40 devstack cinder-volume[86369]: WARNING cinder.quota [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-27642204 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-27642204, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Created reservations ['275506e4-5a2c-4299-ba6c-788abc175f94', '9eaa008c-3db3-4638-acfd-82dc6108b575', '13abe032-9f10-458e-8e4d-8b65c64a7cfc', '91a2a438-ddb9-4863-b353-17fb74cce72e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:40 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:01:40 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:40 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:01:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fbc3c97b-0bc7-4cd3-8c7e-b461174486ad tempest-GroupSnapshotsV319Test-150137802 None] Delete group completed successfully. Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Flow 'volume_create_manager' (87e99061-4d8c-41fa-8f1e-8c0029b8e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e26f563-9fb9-4f53-8100-ebe3f24e553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e26f563-9fb9-4f53-8100-ebe3f24e553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285342883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121053c1-12b8-4af4-b7db-6c15335023bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f507a295157b49279e3aebbbfbd3884e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:46Z,use_quota=True,user_id='7f7ea0ed71cc4cd09a0bfa86344c0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933eefdd-6b9c-410b-a2cd-65cc950290be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933eefdd-6b9c-410b-a2cd-65cc950290be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ade6c81-a079-46e9-9c92-762bca9e940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ade6c81-a079-46e9-9c92-762bca9e940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '121053c1-12b8-4af4-b7db-6c15335023bd', 'volume_name': 'volume-121053c1-12b8-4af4-b7db-6c15335023bd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a23214b-ac1f-415c-9e88-5962be7ec93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a23214b-ac1f-415c-9e88-5962be7ec93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54593aa3-a89d-4d1a-b9f2-260a5de03e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:46 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Volume 121053c1-12b8-4af4-b7db-6c15335023bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-121053c1-12b8-4af4-b7db-6c15335023bd', 'volume_size': 1} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285342883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121053c1-12b8-4af4-b7db-6c15335023bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f507a295157b49279e3aebbbfbd3884e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:46Z,use_quota=True,user_id='7f7ea0ed71cc4cd09a0bfa86344c0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Creating volume 121053c1-12b8-4af4-b7db-6c15335023bd {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:46 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:46 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd 1073741824 Nov 03 13:01:46 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:47 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd 1073741824" returned: 0 in 0.790s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:47 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd Nov 03 13:01:47 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:48 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54593aa3-a89d-4d1a-b9f2-260a5de03e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-121053c1-12b8-4af4-b7db-6c15335023bd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea48793-4a1b-4edd-b957-df7f98e096c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Volume volume-121053c1-12b8-4af4-b7db-6c15335023bd (121053c1-12b8-4af4-b7db-6c15335023bd): created successfully Nov 03 13:01:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea48793-4a1b-4edd-b957-df7f98e096c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Flow 'volume_create_manager' (87e99061-4d8c-41fa-8f1e-8c0029b8e107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1c87510b-9a86-4e22-9c10-d63a1e364888 tempest-VolumesListTestJSON-494907889 None] Created volume successfully. Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=95,cinder:UPDATE=128,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=129,cinder:SELECT=109,cinder:DELETE=11,cinder:INSERT=32 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Flow 'volume_create_manager' (023b662c-2c76-4d45-88a8-a1c37f2e6c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0310df4-ab23-4e93-bacc-3ac4cc6e01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0310df4-ab23-4e93-bacc-3ac4cc6e01db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2056585545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9775afc7-3eaf-48b8-9ade-25d5db92ebd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f507a295157b49279e3aebbbfbd3884e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:49Z,use_quota=True,user_id='7f7ea0ed71cc4cd09a0bfa86344c0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124543e3-a19b-49fd-b50b-d58c0dfb5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124543e3-a19b-49fd-b50b-d58c0dfb5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cec1b3-6a74-4999-93be-5d3c383fb15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cec1b3-6a74-4999-93be-5d3c383fb15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9775afc7-3eaf-48b8-9ade-25d5db92ebd5', 'volume_name': 'volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde044e0-82f2-4740-8b63-3e1dfd69be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde044e0-82f2-4740-8b63-3e1dfd69be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f26dc7-63ad-43d8-9dfa-abfbb4bf4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Volume 9775afc7-3eaf-48b8-9ade-25d5db92ebd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5', 'volume_size': 1} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2056585545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9775afc7-3eaf-48b8-9ade-25d5db92ebd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f507a295157b49279e3aebbbfbd3884e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:49Z,use_quota=True,user_id='7f7ea0ed71cc4cd09a0bfa86344c0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Creating volume 9775afc7-3eaf-48b8-9ade-25d5db92ebd5 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:49 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:49 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 1073741824 Nov 03 13:01:49 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:50 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 1073741824" returned: 0 in 0.868s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:50 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 Nov 03 13:01:50 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:51 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f26dc7-63ad-43d8-9dfa-abfbb4bf4d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec35f0f0-c0be-49ea-8929-d0b687683808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Volume volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 (9775afc7-3eaf-48b8-9ade-25d5db92ebd5): created successfully Nov 03 13:01:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec35f0f0-c0be-49ea-8929-d0b687683808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Flow 'volume_create_manager' (023b662c-2c76-4d45-88a8-a1c37f2e6c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-331af77b-0974-4865-bc53-8fcfe0a393ee tempest-VolumesListTestJSON-494907889 None] Created volume successfully. Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Flow 'volume_create_manager' (daf5e63d-3458-4dcb-9790-846f6bbc053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c4fbc9-0a82-466e-94cf-c537caba896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c4fbc9-0a82-466e-94cf-c537caba896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-975655468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b93d964-75c0-46ce-9558-61f48f480b7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f507a295157b49279e3aebbbfbd3884e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:54Z,use_quota=True,user_id='7f7ea0ed71cc4cd09a0bfa86344c0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b79de-feca-41a5-b1c1-89ca97b048b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b79de-feca-41a5-b1c1-89ca97b048b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454b4e29-8eb8-45cb-a2f2-93c2c8cde6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454b4e29-8eb8-45cb-a2f2-93c2c8cde6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b93d964-75c0-46ce-9558-61f48f480b7c', 'volume_name': 'volume-0b93d964-75c0-46ce-9558-61f48f480b7c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a774a69-b4f9-4a93-8954-e843cbe5c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a774a69-b4f9-4a93-8954-e843cbe5c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f07ded6-d947-4954-86de-0eda168bd186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Volume 0b93d964-75c0-46ce-9558-61f48f480b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b93d964-75c0-46ce-9558-61f48f480b7c', 'volume_size': 1} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-975655468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b93d964-75c0-46ce-9558-61f48f480b7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f507a295157b49279e3aebbbfbd3884e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:01:54Z,use_quota=True,user_id='7f7ea0ed71cc4cd09a0bfa86344c0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Creating volume 0b93d964-75c0-46ce-9558-61f48f480b7c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:01:53 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:01:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:54 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c 1073741824 Nov 03 13:01:54 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:54 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c 1073741824" returned: 0 in 1.100s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:55 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c Nov 03 13:01:55 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:55 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c" returned: 0 in 0.842s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:01:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f07ded6-d947-4954-86de-0eda168bd186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b93d964-75c0-46ce-9558-61f48f480b7c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea20119f-504a-4be0-a91e-d379c140842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:01:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Volume volume-0b93d964-75c0-46ce-9558-61f48f480b7c (0b93d964-75c0-46ce-9558-61f48f480b7c): created successfully Nov 03 13:01:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea20119f-504a-4be0-a91e-d379c140842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:01:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Flow 'volume_create_manager' (daf5e63d-3458-4dcb-9790-846f6bbc053c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:01:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4794a8c7-60ea-4481-919a-ed5ba7623e35 tempest-VolumesListTestJSON-494907889 None] Created volume successfully. Nov 03 13:01:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:01:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:01:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:01:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:01:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:01:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:01:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:01:58 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:01:58 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:01:59 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Nov 03 13:01:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.597s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:01:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:01:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:01:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:01:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:02:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "cinder-0b93d964-75c0-46ce-9558-61f48f480b7c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-0b93d964-75c0-46ce-9558-61f48f480b7c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "cinder-quobyte-0b93d964-75c0-46ce-9558-61f48f480b7c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-quobyte-0b93d964-75c0-46ce-9558-61f48f480b7c" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ddeee9-8505-462f-9fbb-d2e8acbe7e1a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:00 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c Nov 03 13:02:00 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:01 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:01 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c Nov 03 13:02:01 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:01 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0b93d964-75c0-46ce-9558-61f48f480b7c" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-quobyte-0b93d964-75c0-46ce-9558-61f48f480b7c" released by "delete_volume" :: held 0.879s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Created reservations ['681692a9-4a8d-4d6c-93b5-5344d9ccdd03', '455ea510-2a9a-423d-bdd6-fd5be6b5ac53', 'ab0b9879-7dd5-48b4-be90-c953d85d6df6', 'ea0651f8-acac-48a8-80f1-0dc5d1cc21c2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:01 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:01 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "cinder-9775afc7-3eaf-48b8-9ade-25d5db92ebd5-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-9775afc7-3eaf-48b8-9ade-25d5db92ebd5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "cinder-quobyte-9775afc7-3eaf-48b8-9ade-25d5db92ebd5" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:02 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.486s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Deleted volume successfully. Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-quobyte-9775afc7-3eaf-48b8-9ade-25d5db92ebd5" acquired by "delete_volume" :: waited 0.074s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e931d539-ca4e-49cd-a8aa-3bce31ed5316 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-0b93d964-75c0-46ce-9558-61f48f480b7c-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a524faf-378f-4f04-9b4c-3650aa88557c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:02 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 Nov 03 13:02:02 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:02 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c42d9944-feaa-432b-a5d3-7cc22220f27d tempest-GroupsV320Test-1562731383 None] Group tempest-GroupsV320Test-Group-1415207158: creating Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5" returned: 0 in 0.681s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:02 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5 Nov 03 13:02:02 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c42d9944-feaa-432b-a5d3-7cc22220f27d tempest-GroupsV320Test-1562731383 None] Group tempest-GroupsV320Test-Group-1415207158: created successfully Nov 03 13:02:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c42d9944-feaa-432b-a5d3-7cc22220f27d tempest-GroupsV320Test-1562731383 None] Create group completed successfully. Nov 03 13:02:03 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9775afc7-3eaf-48b8-9ade-25d5db92ebd5" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-quobyte-9775afc7-3eaf-48b8-9ade-25d5db92ebd5" released by "delete_volume" :: held 1.024s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Created reservations ['2e2ca54a-232a-40bf-ae1a-2e17e06fb620', 'dc0454f5-011e-4ae8-a8fd-9cf1fbc55a8c', '2ec472d7-8b21-4f18-a95f-88daa0b7e510', 'e787e846-0503-4180-bb64-fd3ec09215fb'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:03 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:03 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:03 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.248s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Deleted volume successfully. Nov 03 13:02:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feca945e-7377-488c-835e-fff2a90da766 tempest-VolumesListTestJSON-494907889 None] Lock "cinder-9775afc7-3eaf-48b8-9ade-25d5db92ebd5-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Acquiring lock "cinder-121053c1-12b8-4af4-b7db-6c15335023bd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Lock "cinder-121053c1-12b8-4af4-b7db-6c15335023bd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Acquiring lock "cinder-quobyte-121053c1-12b8-4af4-b7db-6c15335023bd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Lock "cinder-quobyte-121053c1-12b8-4af4-b7db-6c15335023bd" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Created reservations ['b74d39b0-80e2-431f-8556-b2babdf0755c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8808d416-6b04-4546-91f2-2b58ebea7249]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:04 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:04 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:04 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd Nov 03 13:02:04 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:04 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:04 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4b854b08-019d-4c80-9e29-f5ea2185b3ca tempest-GroupsV320Test-1562731383 None] Delete group completed successfully. Nov 03 13:02:05 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:05 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd Nov 03 13:02:05 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:05 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-121053c1-12b8-4af4-b7db-6c15335023bd" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Lock "cinder-quobyte-121053c1-12b8-4af4-b7db-6c15335023bd" released by "delete_volume" :: held 0.793s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Created reservations ['43fc70c3-b653-4a96-9ed3-5f5d9fe6b3b5', '8b00fc7d-88f2-4e1a-8d4b-6956854180a6', 'ef9babf3-190e-4984-a869-93bec2d6e829', '8f7ee446-ce60-46ed-9d00-b0b85eecdcfe'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:05 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:05 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:05 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Deleted volume successfully. Nov 03 13:02:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9ef0c7-3324-4276-8fc3-fecb11ee8c5d tempest-VolumesListTestJSON-494907889 None] Lock "cinder-121053c1-12b8-4af4-b7db-6c15335023bd-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Flow 'volume_create_manager' (1c5ccf26-e9de-468e-9ebb-3a557e2cb447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08d079a-589b-43f1-b8fc-af3a447fd41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08d079a-589b-43f1-b8fc-af3a447fd41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1479520347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54b7bc4-2507-447c-850b-4fcd31375cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0214be996c584bd18f6c1eb9a4d1dd8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:10Z,use_quota=True,user_id='89752793175a4fde8c1d35fea6f094f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86801fd7-92b0-4e22-9a34-3a643211d816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86801fd7-92b0-4e22-9a34-3a643211d816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3af50c1-cd70-4faf-821a-4bfce617e0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3af50c1-cd70-4faf-821a-4bfce617e0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54b7bc4-2507-447c-850b-4fcd31375cfc', 'volume_name': 'volume-e54b7bc4-2507-447c-850b-4fcd31375cfc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b558b14d-4b8a-4995-84e2-afcbc55363ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b558b14d-4b8a-4995-84e2-afcbc55363ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a862fc3-f0ac-4b3d-8eab-7128674ba3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Volume e54b7bc4-2507-447c-850b-4fcd31375cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54b7bc4-2507-447c-850b-4fcd31375cfc', 'volume_size': 1} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1479520347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54b7bc4-2507-447c-850b-4fcd31375cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0214be996c584bd18f6c1eb9a4d1dd8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:10Z,use_quota=True,user_id='89752793175a4fde8c1d35fea6f094f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Creating volume e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:02:10 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:10 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc 1073741824 Nov 03 13:02:10 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:10 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc 1073741824" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:10 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc Nov 03 13:02:10 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:11 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a862fc3-f0ac-4b3d-8eab-7128674ba3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54b7bc4-2507-447c-850b-4fcd31375cfc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5352f29-3537-4c34-a348-ec8f34e1d4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Volume volume-e54b7bc4-2507-447c-850b-4fcd31375cfc (e54b7bc4-2507-447c-850b-4fcd31375cfc): created successfully Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5352f29-3537-4c34-a348-ec8f34e1d4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Flow 'volume_create_manager' (1c5ccf26-e9de-468e-9ebb-3a557e2cb447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b99d302b-b2d3-4c45-8a18-4c22d7c2d5a8 tempest-VolumesSnapshotListTestJSON-1588382254 None] Created volume successfully. Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Creating offline snapshot a2abce55-af51-4386-950b-174a83c281fd of volume e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[68652f48-c2c0-4ed0-8bb8-a17ea2544140]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:11 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc Nov 03 13:02:11 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:11 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc" returned: 0 in 0.392s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:11 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd 1G Nov 03 13:02:11 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:12 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd 1G" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:12 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd Nov 03 13:02:12 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:12 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:12 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd is being set with open permissions: ugo+rw Nov 03 13:02:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:12 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd Nov 03 13:02:12 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:12 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:13 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.info Nov 03 13:02:13 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:13 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.info" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:13 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.info is being set with open permissions: ugo+rw Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:13 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.info Nov 03 13:02:13 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:13 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.info" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-edac01e8-086e-4cb7-ab1e-24ff60050f20 tempest-VolumesSnapshotListTestJSON-1588382254 None] Create snapshot completed successfully Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Flow 'volume_create_manager' (0aadef38-a67b-41d2-8c3a-5e4ccf2ea219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bacdc1a-c2fd-4e42-951e-dfc316e03ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bacdc1a-c2fd-4e42-951e-dfc316e03ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-830531296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d5b1824d31433f937d4170fb2958dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:14Z,use_quota=True,user_id='aef8932080c9435a8e06f154dadd7b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cfadba-8221-42f3-8f13-404008605290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cfadba-8221-42f3-8f13-404008605290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026cf99c-7fbe-433d-bfab-f2e4405a4bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026cf99c-7fbe-433d-bfab-f2e4405a4bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b', 'volume_name': 'volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6168a2-9b66-4bf9-a0df-5ff774d98cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6168a2-9b66-4bf9-a0df-5ff774d98cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d435f2c0-17e0-44b3-a567-f8acf2986c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Volume 651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b', 'volume_size': 1} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-830531296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d5b1824d31433f937d4170fb2958dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:14Z,use_quota=True,user_id='aef8932080c9435a8e06f154dadd7b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Creating volume 651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:02:13 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:02:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:13 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b 1073741824 Nov 03 13:02:13 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:14 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b 1073741824" returned: 0 in 0.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:14 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b Nov 03 13:02:14 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:14 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b" returned: 0 in 0.246s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d435f2c0-17e0-44b3-a567-f8acf2986c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bc8777-4842-4c24-abde-6cffa380a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Volume volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b (651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b): created successfully Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bc8777-4842-4c24-abde-6cffa380a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Flow 'volume_create_manager' (0aadef38-a67b-41d2-8c3a-5e4ccf2ea219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a9e3b8e9-99a1-4939-a3ea-8c1fa1e75367 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Created volume successfully. Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Creating offline snapshot 2b61e52d-9d66-4392-80d4-dff9404de3e6 of volume e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Acquiring lock "cinder-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b428af1e-e2b4-43de-be38-1518c0290142]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "cinder-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Acquiring lock "cinder-quobyte-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "cinder-quobyte-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1741271b-328e-460c-9d3d-3220f5e829f1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:15 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd Nov 03 13:02:15 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:15 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b Nov 03 13:02:15 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:15 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd" returned: 0 in 0.447s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54b7bc4-2507-447c-850b-4fcd31375cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:15 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 1G Nov 03 13:02:15 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:15 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b" returned: 0 in 0.426s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:15 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b Nov 03 13:02:15 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:15 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "cinder-quobyte-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b" released by "delete_volume" :: held 0.839s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Created reservations ['827d158e-ca99-49c4-b499-d78282e0d823', 'a6700ca9-3608-4e9a-8d35-544ed4a0134b', 'a2bf801a-8d7e-4825-a06c-e8bac8342d56', 'd9fd3a1a-a9c6-47be-8703-831db9faa5c9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:16 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:16 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 1G" returned: 0 in 0.789s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:16 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:16 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 Nov 03 13:02:16 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:16 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.536s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Deleted volume successfully. Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b257bdcd-d2be-4e65-8d40-dd89eb39bd67 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "cinder-651b8ee9-3fe6-4cc8-a612-9a0ba1a5298b-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:16 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6" returned: 0 in 0.734s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:16 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 is being set with open permissions: ugo+rw Nov 03 13:02:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:16 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 Nov 03 13:02:16 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Flow 'volume_create_manager' (3818e692-30aa-4222-9ab5-923168e16ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d585fdc-9779-4cfe-8622-01d63d6cb7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d585fdc-9779-4cfe-8622-01d63d6cb7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-105099073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488d2448-422c-485a-ba0e-f40af1dc3701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d5b1824d31433f937d4170fb2958dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:17Z,use_quota=True,user_id='aef8932080c9435a8e06f154dadd7b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6de98-a9c7-4dfa-819b-d67f39d796b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6de98-a9c7-4dfa-819b-d67f39d796b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:17 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5abc9a-fb47-4eb2-8387-b637d854d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5abc9a-fb47-4eb2-8387-b637d854d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488d2448-422c-485a-ba0e-f40af1dc3701', 'volume_name': 'volume-488d2448-422c-485a-ba0e-f40af1dc3701', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d548871-985c-4d5d-86e8-22041b3b33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d548871-985c-4d5d-86e8-22041b3b33a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc3206a-4014-4471-83a3-51575dd4c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Volume 488d2448-422c-485a-ba0e-f40af1dc3701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488d2448-422c-485a-ba0e-f40af1dc3701', 'volume_size': 1} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-105099073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488d2448-422c-485a-ba0e-f40af1dc3701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d5b1824d31433f937d4170fb2958dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:17Z,use_quota=True,user_id='aef8932080c9435a8e06f154dadd7b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Creating volume 488d2448-422c-485a-ba0e-f40af1dc3701 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:02:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:17 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 1073741824 Nov 03 13:02:17 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-93732c92-a2e2-49d9-9615-ba9254ce4ae1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Create snapshot completed successfully Nov 03 13:02:17 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 1073741824" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:17 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 Nov 03 13:02:17 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:18 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc3206a-4014-4471-83a3-51575dd4c41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488d2448-422c-485a-ba0e-f40af1dc3701', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0babe20b-cfef-44e9-8535-e87d3c4be1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Volume volume-488d2448-422c-485a-ba0e-f40af1dc3701 (488d2448-422c-485a-ba0e-f40af1dc3701): created successfully Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0babe20b-cfef-44e9-8535-e87d3c4be1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Flow 'volume_create_manager' (3818e692-30aa-4222-9ab5-923168e16ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8288b39e-e0d6-4c2a-8495-e653c97ef999 tempest-VolumeQuotasAdminTestJSON-1975977922 None] Created volume successfully. Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Creating offline snapshot ccd245f8-3e8f-4899-b995-d7f1de350e4e of volume e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b940c2-1754-4fa4-9e48-36a85ef4046b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:18 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 Nov 03 13:02:18 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:18 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6" returned: 0 in 0.461s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54b7bc4-2507-447c-850b-4fcd31375cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:02:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:18 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e 1G Nov 03 13:02:18 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:19 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e 1G" returned: 0 in 0.654s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:19 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e Nov 03 13:02:19 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Flow 'volume_create_manager' (88b30924-80c9-40b8-a0bc-71e170805d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e848e4b0-e38a-44a8-b405-c608b480db34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e848e4b0-e38a-44a8-b405-c608b480db34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1588111446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b968b38-6eaa-4a92-b429-9818d0e577fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f5d569de5948edb17237b476cad7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:20Z,use_quota=True,user_id='fb136ce800d64b2ca948c23910c1dfe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e0ca49-5766-405c-bfff-a933605414e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e0ca49-5766-405c-bfff-a933605414e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df6f0a0-e356-4626-b610-754650e2a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df6f0a0-e356-4626-b610-754650e2a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b968b38-6eaa-4a92-b429-9818d0e577fe', 'volume_name': 'volume-5b968b38-6eaa-4a92-b429-9818d0e577fe', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5147f8-3c29-41ae-afeb-bfc1480b2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5147f8-3c29-41ae-afeb-bfc1480b2029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89caec5-f022-4732-8294-66449801f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Volume 5b968b38-6eaa-4a92-b429-9818d0e577fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b968b38-6eaa-4a92-b429-9818d0e577fe', 'volume_size': 1} Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:19 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:19 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e is being set with open permissions: ugo+rw Nov 03 13:02:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:19 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e Nov 03 13:02:19 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-01442ff4-b9c5-4e83-b91f-565cd7598440 tempest-VolumeQuotasAdminTestJSON-273263888 None] Transfer volume completed successfully. Nov 03 13:02:20 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1588111446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b968b38-6eaa-4a92-b429-9818d0e577fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72f5d569de5948edb17237b476cad7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:20Z,use_quota=True,user_id='fb136ce800d64b2ca948c23910c1dfe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Creating volume 5b968b38-6eaa-4a92-b429-9818d0e577fe {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:02:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:20 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe 1073741824 Nov 03 13:02:20 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5c42e075-c579-4139-b21d-84262c3984e1 tempest-VolumesSnapshotListTestJSON-1588382254 None] Create snapshot completed successfully Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Acquiring lock "cinder-488d2448-422c-485a-ba0e-f40af1dc3701-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Lock "cinder-488d2448-422c-485a-ba0e-f40af1dc3701-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Acquiring lock "cinder-quobyte-488d2448-422c-485a-ba0e-f40af1dc3701" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Lock "cinder-quobyte-488d2448-422c-485a-ba0e-f40af1dc3701" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3564b8-29d5-4390-8329-7629ab18cf4f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:20 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe 1073741824" returned: 0 in 0.699s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:21 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 Nov 03 13:02:21 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:21 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe Nov 03 13:02:21 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:21 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe" returned: 0 in 0.340s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:21 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701" returned: 0 in 0.500s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89caec5-f022-4732-8294-66449801f37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b968b38-6eaa-4a92-b429-9818d0e577fe', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fbd034-f96c-4780-88af-7030dbed8a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:21 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701 Nov 03 13:02:21 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Volume volume-5b968b38-6eaa-4a92-b429-9818d0e577fe (5b968b38-6eaa-4a92-b429-9818d0e577fe): created successfully Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fbd034-f96c-4780-88af-7030dbed8a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Flow 'volume_create_manager' (88b30924-80c9-40b8-a0bc-71e170805d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9953975a-7428-43e8-8ebb-283028434eff tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Created volume successfully. Nov 03 13:02:21 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-488d2448-422c-485a-ba0e-f40af1dc3701" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Lock "cinder-quobyte-488d2448-422c-485a-ba0e-f40af1dc3701" released by "delete_volume" :: held 0.852s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-ccd245f8-3e8f-4899-b995-d7f1de350e4e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-ccd245f8-3e8f-4899-b995-d7f1de350e4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-quobyte-ccd245f8-3e8f-4899-b995-d7f1de350e4e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-ccd245f8-3e8f-4899-b995-d7f1de350e4e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Deleting offline snapshot ccd245f8-3e8f-4899-b995-d7f1de350e4e of volume e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] snapshot_file for this snap is: volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Created reservations ['59f297e0-7b76-4d94-951f-73aff85aaf3d', '76e2f46a-3954-40db-a26e-c8d7842f0200', '0369f37d-28e9-4c13-9815-7b4f7033bb6d', 'b8f3116c-6940-4017-8cac-abe74ca010b4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991c4cd-5a78-4787-b4ad-28c6ff611510]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-496a0da0-ff2c-4e12-87bb-17a1629b25eb req-42abd5d9-1054-4245-8048-f7e0dafba73c tempest-AttachVolumeNegativeTest-914678679 None] Terminate volume connection completed successfully. Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-496a0da0-ff2c-4e12-87bb-17a1629b25eb req-42abd5d9-1054-4245-8048-f7e0dafba73c tempest-AttachVolumeNegativeTest-914678679 None] Deleting attachment 1ac4bbc6-dc28-4b2b-bae7-7a906a5a1040. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:21 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:21 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:22 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e Nov 03 13:02:22 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:22 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Deleted volume successfully. Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d356df1-904b-48e4-8512-cae51e34cc66 tempest-VolumeQuotasAdminTestJSON-782693606 None] Lock "cinder-488d2448-422c-485a-ba0e-f40af1dc3701-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:22 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e" returned: 0 in 0.528s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54b7bc4-2507-447c-850b-4fcd31375cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e24af-b68f-430a-b333-53e5fe79d9a4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:22 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 Nov 03 13:02:22 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:22 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6" returned: 0 in 0.461s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54b7bc4-2507-447c-850b-4fcd31375cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:22 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e Nov 03 13:02:22 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1d4764b6-9395-4355-9255-09e74eed12ea req-509aa61a-d052-4f7d-9c87-e524696c2848 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1d4764b6-9395-4355-9255-09e74eed12ea req-509aa61a-d052-4f7d-9c87-e524696c2848 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-1d4764b6-9395-4355-9255-09e74eed12ea req-509aa61a-d052-4f7d-9c87-e524696c2848 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-1d4764b6-9395-4355-9255-09e74eed12ea req-509aa61a-d052-4f7d-9c87-e524696c2848 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-5b968b38-6eaa-4a92-b429-9818d0e577fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d8caf82-118d-47ff-b248-8447d36967cb', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:02:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-1d4764b6-9395-4355-9255-09e74eed12ea req-509aa61a-d052-4f7d-9c87-e524696c2848 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] attachment_update completed successfully. Nov 03 13:02:23 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e" returned: 0 in 0.800s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:23 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e Nov 03 13:02:23 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:24 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.ccd245f8-3e8f-4899-b995-d7f1de350e4e" returned: 0 in 0.488s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-ccd245f8-3e8f-4899-b995-d7f1de350e4e" released by "_delete_snapshot" :: held 2.454s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" released by "delete_snapshot" :: held 2.506s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Created reservations ['e42acd4a-5ba4-4f75-b0da-8e320f19b356', '5938f1e6-d3bf-4ceb-ad89-941bfd6d4f43', '0b59f88a-49e5-4922-8830-9e0bf86417b3', '42c3c8b2-6ef4-42c5-a685-d3253614dcc3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Delete snapshot completed successfully. Nov 03 13:02:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2925061f-0d11-419c-a606-064f323208a4 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-ccd245f8-3e8f-4899-b995-d7f1de350e4e-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-2b61e52d-9d66-4392-80d4-dff9404de3e6-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-2b61e52d-9d66-4392-80d4-dff9404de3e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-quobyte-2b61e52d-9d66-4392-80d4-dff9404de3e6" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-2b61e52d-9d66-4392-80d4-dff9404de3e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Deleting offline snapshot 2b61e52d-9d66-4392-80d4-dff9404de3e6 of volume e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] snapshot_file for this snap is: volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[11525bb3-0a6e-4817-a363-f20529bbd497]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:25 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 Nov 03 13:02:25 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:25 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6" returned: 0 in 0.515s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54b7bc4-2507-447c-850b-4fcd31375cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269daef-e4c0-46d3-a77f-5ae65ad804ea]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:25 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd Nov 03 13:02:25 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:26 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd" returned: 0 in 0.513s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54b7bc4-2507-447c-850b-4fcd31375cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:02:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:26 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 Nov 03 13:02:26 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:26 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6" returned: 0 in 0.529s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:26 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6 Nov 03 13:02:26 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:27 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.2b61e52d-9d66-4392-80d4-dff9404de3e6" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-2b61e52d-9d66-4392-80d4-dff9404de3e6" released by "_delete_snapshot" :: held 2.053s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" released by "delete_snapshot" :: held 2.083s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:27 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Created reservations ['323dde1e-fd26-4ced-98dc-5d0fdebbeebe', 'a9e37855-8b82-4e92-9529-5940d5cb05b3', '0b86c316-6301-4651-8807-0d79dc329af1', '41e2094d-85de-4b02-8de0-93e7fb3f2b51'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-65311a80-99f6-4517-bab9-ca4d325cd24b req-39b91ccf-0ff6-4bb7-b91d-f65830a06e08 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Terminate volume connection completed successfully. Nov 03 13:02:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-65311a80-99f6-4517-bab9-ca4d325cd24b req-39b91ccf-0ff6-4bb7-b91d-f65830a06e08 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Deleting attachment 8d8caf82-118d-47ff-b248-8447d36967cb. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:02:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Delete snapshot completed successfully. Nov 03 13:02:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1de632ef-058e-41cc-bfd4-0f764d5f3a55 tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-2b61e52d-9d66-4392-80d4-dff9404de3e6-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Acquiring lock "cinder-5b968b38-6eaa-4a92-b429-9818d0e577fe-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "cinder-5b968b38-6eaa-4a92-b429-9818d0e577fe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Acquiring lock "cinder-quobyte-5b968b38-6eaa-4a92-b429-9818d0e577fe" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "cinder-quobyte-5b968b38-6eaa-4a92-b429-9818d0e577fe" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[391fb1ca-2cff-4cb0-9b66-25c891dc5a09]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-a2abce55-af51-4386-950b-174a83c281fd-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-a2abce55-af51-4386-950b-174a83c281fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-quobyte-a2abce55-af51-4386-950b-174a83c281fd" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-a2abce55-af51-4386-950b-174a83c281fd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Deleting offline snapshot a2abce55-af51-4386-950b-174a83c281fd of volume e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:02:28 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe Nov 03 13:02:28 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] snapshot_file for this snap is: volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38514a-f330-4d7c-852b-67bcfe174570]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:28 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd Nov 03 13:02:28 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:28 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe" returned: 0 in 0.535s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:28 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe Nov 03 13:02:28 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:28 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd" returned: 0 in 0.492s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54b7bc4-2507-447c-850b-4fcd31375cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e834e650-d252-4fde-bc10-12e52d95151e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:29 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc Nov 03 13:02:29 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:29 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5b968b38-6eaa-4a92-b429-9818d0e577fe" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "cinder-quobyte-5b968b38-6eaa-4a92-b429-9818d0e577fe" released by "delete_volume" :: held 0.936s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Created reservations ['2b66ef74-6cfd-47a9-829c-666815eb8d71', '9ae0ceef-2683-41d0-847f-4cb7f7abb72c', '33470bda-878d-405d-9e92-168402d28abc', '3ce1e300-7b6c-4c5e-af92-f28721f49093'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:29 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:29 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:29 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc" returned: 0 in 0.504s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:29 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd Nov 03 13:02:29 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:29 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Deleted volume successfully. Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e4e49df-feae-459e-a91c-9ade5c54f697 tempest-TestServerVolumeAttachScenarioOldVersion-1236924184 None] Lock "cinder-5b968b38-6eaa-4a92-b429-9818d0e577fe-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:29 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:29 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd Nov 03 13:02:29 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:30 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc.a2abce55-af51-4386-950b-174a83c281fd" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-a2abce55-af51-4386-950b-174a83c281fd" released by "_delete_snapshot" :: held 1.823s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" released by "delete_snapshot" :: held 1.848s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Created reservations ['11ea039e-a1da-4457-ab9c-f081fb172c23', '460919d2-abf7-40ed-afc5-445083a64d93', 'b9008708-9d91-40f8-a837-6ea104fbf972', '6a7fa30e-3c94-4519-84a4-207d9c7c9d97'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Delete snapshot completed successfully. Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc26ed1d-3f65-4ff9-8346-be6cc7ecd1ca tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-a2abce55-af51-4386-950b-174a83c281fd-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-e54b7bc4-2507-447c-850b-4fcd31375cfc-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-e54b7bc4-2507-447c-850b-4fcd31375cfc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a6304-7dbb-4cbf-a1af-7bfed5b84b56]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:30 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc Nov 03 13:02:30 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:31 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc" returned: 0 in 0.688s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:31 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc Nov 03 13:02:31 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:31 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e54b7bc4-2507-447c-850b-4fcd31375cfc" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-quobyte-e54b7bc4-2507-447c-850b-4fcd31375cfc" released by "delete_volume" :: held 1.209s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Created reservations ['f4dbcc90-6bff-4554-abcd-f3748d25f709', '7162cbdd-c5fd-4ea4-b1f0-6a42db6725ce', '3d4acdca-8a26-4449-8462-9e7217c5e3aa', '352a2456-eed2-4910-9398-7421db9d868b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:32 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:32 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:32 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Deleted volume successfully. Nov 03 13:02:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-977c2202-3566-4a14-9171-9e5277e4540d tempest-VolumesSnapshotListTestJSON-1588382254 None] Lock "cinder-e54b7bc4-2507-447c-850b-4fcd31375cfc-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Flow 'volume_create_manager' (2416ba03-a488-4aad-94fe-bb7db9e53997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74637d32-6074-40d7-8019-38b58abd1742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74637d32-6074-40d7-8019-38b58abd1742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-667726415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8490df-2796-4b1e-aa18-6256856cb188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb90c81539c44d4493f68b023eb70d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:35Z,use_quota=True,user_id='732e73124c684b30a44ff25acbce92e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c7b16ad-0048-4b3e-bc38-607a36c4d0dc),volume_type_id=8c7b16ad-0048-4b3e-bc38-607a36c4d0dc)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8d38de-e6a2-404c-af9f-0d1b26c3c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8d38de-e6a2-404c-af9f-0d1b26c3c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db58c284-6a1d-4115-8fd4-da3d62654f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db58c284-6a1d-4115-8fd4-da3d62654f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8490df-2796-4b1e-aa18-6256856cb188', 'volume_name': 'volume-4b8490df-2796-4b1e-aa18-6256856cb188', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d4df44-f85c-41c6-b967-1b8f28ceb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d4df44-f85c-41c6-b967-1b8f28ceb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe55d5b4-e1c6-48e4-a478-4fcae7435fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Volume 4b8490df-2796-4b1e-aa18-6256856cb188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8490df-2796-4b1e-aa18-6256856cb188', 'volume_size': 1} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-667726415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8490df-2796-4b1e-aa18-6256856cb188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb90c81539c44d4493f68b023eb70d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:02:35Z,use_quota=True,user_id='732e73124c684b30a44ff25acbce92e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c7b16ad-0048-4b3e-bc38-607a36c4d0dc),volume_type_id=8c7b16ad-0048-4b3e-bc38-607a36c4d0dc)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Creating volume 4b8490df-2796-4b1e-aa18-6256856cb188 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:02:35 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:35 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 1073741824 Nov 03 13:02:35 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:35 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 1073741824" returned: 0 in 0.603s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:35 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 Nov 03 13:02:35 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:36 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188" returned: 0 in 0.392s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:02:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe55d5b4-e1c6-48e4-a478-4fcae7435fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8490df-2796-4b1e-aa18-6256856cb188', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cc863b-5632-45e6-8b46-f6382b3adef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:02:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Volume volume-4b8490df-2796-4b1e-aa18-6256856cb188 (4b8490df-2796-4b1e-aa18-6256856cb188): created successfully Nov 03 13:02:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cc863b-5632-45e6-8b46-f6382b3adef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:02:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Flow 'volume_create_manager' (2416ba03-a488-4aad-94fe-bb7db9e53997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:02:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c2f1c6e4-f471-4f0c-9a56-bdcbfc57593c tempest-VolumeTypesAccessTest-464483650 None] Created volume successfully. Nov 03 13:02:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Acquiring lock "cinder-4b8490df-2796-4b1e-aa18-6256856cb188-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Lock "cinder-4b8490df-2796-4b1e-aa18-6256856cb188-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Acquiring lock "cinder-quobyte-4b8490df-2796-4b1e-aa18-6256856cb188" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:02:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Lock "cinder-quobyte-4b8490df-2796-4b1e-aa18-6256856cb188" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:02:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[298993df-739f-48d2-8304-962c6d6ccdd9]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:02:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:38 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 Nov 03 13:02:38 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:38 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188" returned: 0 in 0.794s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:38 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188 Nov 03 13:02:38 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:39 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b8490df-2796-4b1e-aa18-6256856cb188" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Lock "cinder-quobyte-4b8490df-2796-4b1e-aa18-6256856cb188" released by "delete_volume" :: held 1.359s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:39 devstack cinder-volume[86369]: WARNING cinder.quota [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1094356089 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1094356089, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:02:39 devstack cinder-volume[86369]: WARNING cinder.quota [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1094356089 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1094356089, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Created reservations ['4d8b772c-8a6b-44c0-b25d-b056fb2088a8', 'f9f50119-877f-4543-b99c-495b12fbe180', '0cbaa848-a313-49fe-8ed4-f32bc1598f53', '1489f6a3-aa93-494c-bf1a-38e7624a928d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:39 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:39 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:40 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.540s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Deleted volume successfully. Nov 03 13:02:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a19605ba-1c51-41ff-9c59-3c4fb9075e9c tempest-VolumeTypesAccessTest-464483650 None] Lock "cinder-4b8490df-2796-4b1e-aa18-6256856cb188-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:02:49 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=101,cinder:DELETE=8,cinder:SELECT=93,cinder:INSERT=25 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:02:50 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=91,cinder:INSERT=28,cinder:UPDATE=118,cinder:DELETE=10 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:02:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:02:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:02:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:02:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:02:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:02:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:02:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:02:58 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:02:58 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:02:58 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Nov 03 13:02:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:02:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:02:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:02:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:02:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Flow 'volume_create_manager' (4b9542d4-5cee-49c4-b913-392e2b5f9e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb7885a-8d08-4859-922c-980aac9c9cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb7885a-8d08-4859-922c-980aac9c9cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-900195468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc67254-097d-4efb-8359-bb4cf410bf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b72c2ff2974ece8ab2925302009ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:06Z,use_quota=True,user_id='307b830f5e614c78b0f8ab06fa064eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c242b3a0-57d0-4fd0-8f2b-ac021dd19d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c242b3a0-57d0-4fd0-8f2b-ac021dd19d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0632c953-8a96-47be-9a36-820c02744527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0632c953-8a96-47be-9a36-820c02744527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc67254-097d-4efb-8359-bb4cf410bf8f', 'volume_name': 'volume-8cc67254-097d-4efb-8359-bb4cf410bf8f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70e970d-ed22-4a7c-a7ab-3c619ac50775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70e970d-ed22-4a7c-a7ab-3c619ac50775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e1a947-6c9f-4419-a58a-d4bc5602ef45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Volume 8cc67254-097d-4efb-8359-bb4cf410bf8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc67254-097d-4efb-8359-bb4cf410bf8f', 'volume_size': 1} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-900195468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc67254-097d-4efb-8359-bb4cf410bf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b72c2ff2974ece8ab2925302009ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:06Z,use_quota=True,user_id='307b830f5e614c78b0f8ab06fa064eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Creating volume 8cc67254-097d-4efb-8359-bb4cf410bf8f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:03:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:03:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:05 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f 1073741824 Nov 03 13:03:05 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:06 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f 1073741824" returned: 0 in 0.761s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:06 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f Nov 03 13:03:06 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:06 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:03:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e1a947-6c9f-4419-a58a-d4bc5602ef45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc67254-097d-4efb-8359-bb4cf410bf8f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f22ba0-3926-485f-b5b0-d29d348f5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Volume volume-8cc67254-097d-4efb-8359-bb4cf410bf8f (8cc67254-097d-4efb-8359-bb4cf410bf8f): created successfully Nov 03 13:03:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f22ba0-3926-485f-b5b0-d29d348f5270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Flow 'volume_create_manager' (4b9542d4-5cee-49c4-b913-392e2b5f9e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b7a311ca-7db0-46a1-a33c-4bc3a22b312c tempest-TestImageHashVerification-1499872614 None] Created volume successfully. Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Flow 'volume_create_manager' (28a8b466-db41-4c3b-95fc-25342681b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a702fa03-0a67-4b61-9ae0-194a695fe326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a702fa03-0a67-4b61-9ae0-194a695fe326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-893398634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe4c848-b90d-4d90-92af-edf36e732e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d559683d1b3644c4ae68789801aed69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:08Z,use_quota=True,user_id='e4732bfcb5594cf993c82ff7ca130933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c335f615-fb4a-4ff6-9b0e-290476a1425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c335f615-fb4a-4ff6-9b0e-290476a1425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a83a48-3cfc-470e-b105-937f9b9c38cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a83a48-3cfc-470e-b105-937f9b9c38cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe4c848-b90d-4d90-92af-edf36e732e47', 'volume_name': 'volume-4fe4c848-b90d-4d90-92af-edf36e732e47', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce17d8f-418a-4d9a-8f16-d1ed1c9e9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce17d8f-418a-4d9a-8f16-d1ed1c9e9763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8fbe9c-8c97-4c1c-8d91-523782771b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Volume 4fe4c848-b90d-4d90-92af-edf36e732e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe4c848-b90d-4d90-92af-edf36e732e47', 'volume_size': 1} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-893398634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe4c848-b90d-4d90-92af-edf36e732e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d559683d1b3644c4ae68789801aed69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:08Z,use_quota=True,user_id='e4732bfcb5594cf993c82ff7ca130933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Creating volume 4fe4c848-b90d-4d90-92af-edf36e732e47 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:03:08 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:03:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:08 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 1073741824 Nov 03 13:03:08 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:09 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 1073741824" returned: 0 in 0.585s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:09 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 Nov 03 13:03:09 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:09 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8fbe9c-8c97-4c1c-8d91-523782771b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe4c848-b90d-4d90-92af-edf36e732e47', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bef4a38-2cb0-460a-9903-4c6121edd31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Volume volume-4fe4c848-b90d-4d90-92af-edf36e732e47 (4fe4c848-b90d-4d90-92af-edf36e732e47): created successfully Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bef4a38-2cb0-460a-9903-4c6121edd31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Flow 'volume_create_manager' (28a8b466-db41-4c3b-95fc-25342681b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-959cbaaa-d4bc-4d4b-8f26-aacab2d15d8b tempest-AttachVolumeNegativeTest-914678679 None] Created volume successfully. Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe8aad7-bc8b-4da3-85db-8af2eaaa5fbc]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:09 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f Nov 03 13:03:09 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:10 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b24a75-1a21-4c3b-b22c-ee576453d817]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:10 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f Nov 03 13:03:10 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:10 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f" returned: 0 in 0.430s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f /opt/stack/data/cinder/conversion/8cc67254-097d-4efb-8359-bb4cf410bf8f.temp_image.cd99bed3-1174-451f-8870-51e223d0e538itc8wq7f.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:10 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f /opt/stack/data/cinder/conversion/8cc67254-097d-4efb-8359-bb4cf410bf8f.temp_image.cd99bed3-1174-451f-8870-51e223d0e538itc8wq7f.img Nov 03 13:03:10 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-9116a853-9f95-4348-9eec-9818c61bc48a req-9cbd5121-7acd-4dd7-af29-81ea132a4061 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:19 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f /opt/stack/data/cinder/conversion/8cc67254-097d-4efb-8359-bb4cf410bf8f.temp_image.cd99bed3-1174-451f-8870-51e223d0e538itc8wq7f.img" returned: 0 in 8.494s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c0feec-b18a-4af3-bc1a-ce2c517aa5a1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:19 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f Nov 03 13:03:19 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:19 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f" returned: 0 in 0.673s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:19 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f, size 1024.00 MB, duration 8.50 sec, destination /opt/stack/data/cinder/conversion/8cc67254-097d-4efb-8359-bb4cf410bf8f.temp_image.cd99bed3-1174-451f-8870-51e223d0e538itc8wq7f.img {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:03:19 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Converted 1024.00 MB image at 120.51 MB/s Nov 03 13:03:19 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] cd99bed3-1174-451f-8870-51e223d0e538 was raw, no need to convert to raw {{(pid=86369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 13:03:29 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:03:29 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=9,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (a75273e7-9943-42ee-9d7e-d1d99773d2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2430c9d7-9862-46ef-b133-eb48c5ef2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2430c9d7-9862-46ef-b133-eb48c5ef2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1162947004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1e33b1-b617-47f7-82d7-fe08038a106c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:37Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41efaca3-dbc8-4d1d-9527-b62ece1bc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41efaca3-dbc8-4d1d-9527-b62ece1bc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60da228d-5617-48d6-8c32-ab65f8a77535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60da228d-5617-48d6-8c32-ab65f8a77535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1e33b1-b617-47f7-82d7-fe08038a106c', 'volume_name': 'volume-dc1e33b1-b617-47f7-82d7-fe08038a106c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfabe54a-88a2-4ce9-9675-bc209a8c2453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfabe54a-88a2-4ce9-9675-bc209a8c2453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c2cbd8-3361-41e8-9ed3-ea6f58dfd46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Volume dc1e33b1-b617-47f7-82d7-fe08038a106c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1e33b1-b617-47f7-82d7-fe08038a106c', 'volume_size': 1} Nov 03 13:03:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:46 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:03:46 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.655s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Uploaded volume to glance image-id: cd99bed3-1174-451f-8870-51e223d0e538. {{(pid=86369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-9116a853-9f95-4348-9eec-9818c61bc48a req-9cbd5121-7acd-4dd7-af29-81ea132a4061 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 37.585s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ffa0fdcd-b4f2-4444-bed9-ffa6022ede60 tempest-TestImageHashVerification-1499872614 None] Copy volume to image completed successfully. Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-9116a853-9f95-4348-9eec-9818c61bc48a req-9cbd5121-7acd-4dd7-af29-81ea132a4061 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.410s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1162947004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1e33b1-b617-47f7-82d7-fe08038a106c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:37Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Creating volume dc1e33b1-b617-47f7-82d7-fe08038a106c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:03:49 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:03:49 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c 1073741824 Nov 03 13:03:49 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Flow 'volume_create_manager' (adc9fcbb-3ccf-4c4d-a1b6-508eb7ec6f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e628d8a9-2faf-49a4-88d9-2d047fa03960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e628d8a9-2faf-49a4-88d9-2d047fa03960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-59700986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca90e4d-185d-4f24-bf68-956f2335c049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0793e660ecf42879d2bd4498b4251c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:49Z,use_quota=True,user_id='6bcad58f0c304e7fae8998cfa711f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8aedf8-e527-4f57-8bab-f59df4bdbcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8aedf8-e527-4f57-8bab-f59df4bdbcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91d06c4-17ab-43ba-9e33-3218c2d30da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-9116a853-9f95-4348-9eec-9818c61bc48a req-9cbd5121-7acd-4dd7-af29-81ea132a4061 tempest-AttachVolumeNegativeTest-914678679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-4fe4c848-b90d-4d90-92af-edf36e732e47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c072a318-6b5e-4ccf-b9a7-37afdf1a9de0', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:03:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-9116a853-9f95-4348-9eec-9818c61bc48a req-9cbd5121-7acd-4dd7-af29-81ea132a4061 tempest-AttachVolumeNegativeTest-914678679 None] attachment_update completed successfully. Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91d06c4-17ab-43ba-9e33-3218c2d30da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ca90e4d-185d-4f24-bf68-956f2335c049', 'volume_name': 'volume-6ca90e4d-185d-4f24-bf68-956f2335c049', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b531217d-bf3a-4fce-bf2b-75790d9950e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b531217d-bf3a-4fce-bf2b-75790d9950e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537f1c1e-e956-4397-bf7f-638a8f58e366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Volume 6ca90e4d-185d-4f24-bf68-956f2335c049: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ca90e4d-185d-4f24-bf68-956f2335c049', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Trying to clone 6ca90e4d-185d-4f24-bf68-956f2335c049 from image 68321eb5-d635-47b3-850b-90ed52040d26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:03:49 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c 1073741824" returned: 0 in 0.544s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:49 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c Nov 03 13:03:49 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:03:50 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:03:50 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c" returned: 0 in 0.501s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c2cbd8-3361-41e8-9ed3-ea6f58dfd46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1e33b1-b617-47f7-82d7-fe08038a106c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3a76b1-0385-4217-a6b0-881a7bf68fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd43821f-13c9-4b9c-a0f4-2b035319bb24]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Volume volume-dc1e33b1-b617-47f7-82d7-fe08038a106c (dc1e33b1-b617-47f7-82d7-fe08038a106c): created successfully Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3a76b1-0385-4217-a6b0-881a7bf68fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (a75273e7-9943-42ee-9d7e-d1d99773d2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-895f0490-0432-43f3-9e48-79105ca28276 tempest-VolumesActionsTest-301914732 None] Created volume successfully. Nov 03 13:03:50 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD Nov 03 13:03:50 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Acquiring lock "cinder-8cc67254-097d-4efb-8359-bb4cf410bf8f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Lock "cinder-8cc67254-097d-4efb-8359-bb4cf410bf8f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Acquiring lock "cinder-quobyte-8cc67254-097d-4efb-8359-bb4cf410bf8f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Lock "cinder-quobyte-8cc67254-097d-4efb-8359-bb4cf410bf8f" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:03:50 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 is fetched for user 6bcad58f0c304e7fae8998cfa711f392. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6820a4-215c-4452-9b2b-327b908d0237]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a220a14-1dbf-4fd0-99e3-a6f16811a81d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:51 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f Nov 03 13:03:51 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:51 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD Nov 03 13:03:51 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:51 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-59700986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca90e4d-185d-4f24-bf68-956f2335c049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0793e660ecf42879d2bd4498b4251c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:03:49Z,use_quota=True,user_id='6bcad58f0c304e7fae8998cfa711f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Creating volume 6ca90e4d-185d-4f24-bf68-956f2335c049 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:03:51 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:51 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd1be263-7f17-4824-899f-b1480d398a9e tempest-VolumesActionsTest-301914732 None] Acquiring lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c" by "attach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:51 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 1073741824 Nov 03 13:03:51 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd1be263-7f17-4824-899f-b1480d398a9e tempest-VolumesActionsTest-301914732 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c" acquired by "attach_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:03:51 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f Nov 03 13:03:51 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bd1be263-7f17-4824-899f-b1480d398a9e tempest-VolumesActionsTest-301914732 None] Attaching volume dc1e33b1-b617-47f7-82d7-fe08038a106c to instance 141e09a7-5bc0-4230-ab62-7369b30ef8d9 at mountpoint /dev/vdb on host None. Nov 03 13:03:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bd1be263-7f17-4824-899f-b1480d398a9e tempest-VolumesActionsTest-301914732 None] Attach volume completed successfully. Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd1be263-7f17-4824-899f-b1480d398a9e tempest-VolumesActionsTest-301914732 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c" released by "attach_volume" :: held 0.123s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:03:51 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8cc67254-097d-4efb-8359-bb4cf410bf8f" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Lock "cinder-quobyte-8cc67254-097d-4efb-8359-bb4cf410bf8f" released by "delete_volume" :: held 0.848s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Created reservations ['afb11fec-cfd4-4a1a-bb32-4cf150467d8d', '21137167-239f-423d-b82b-ffd3d26f5754', 'b7e2d7d5-0cc1-4977-99c9-5faff271d559', '7c6bf9e5-cede-4af5-9fef-3d04e9feb6c8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:51 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:03:51 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:51 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 1073741824" returned: 0 in 0.655s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:52 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 Nov 03 13:03:52 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:52 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:03:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Deleted volume successfully. Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8757fd5b-bb10-4bc8-ba16-4c80bb0ffdfa tempest-TestImageHashVerification-1499872614 None] Lock "cinder-8cc67254-097d-4efb-8359-bb4cf410bf8f-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:03:52 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Attempting download of 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 6ca90e4d-185d-4f24-bf68-956f2335c049. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:03:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-3ebc0b65-cd3b-42bd-a00c-2b1fa18ce6ef req-93707481-c6d1-4402-b9a4-de60f3e06fb9 tempest-AttachVolumeNegativeTest-914678679 None] Terminate volume connection completed successfully. Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-3ebc0b65-cd3b-42bd-a00c-2b1fa18ce6ef req-93707481-c6d1-4402-b9a4-de60f3e06fb9 tempest-AttachVolumeNegativeTest-914678679 None] Deleting attachment c072a318-6b5e-4ccf-b9a7-37afdf1a9de0. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c076ed59-489b-410b-870b-adf9bec5d8e6]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_qy5gok61 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1f5eae04-34d9-4f19-a9ed-ec543704584b tempest-VolumesActionsTest-1852279345 None] Terminate volume connection completed successfully. Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f5eae04-34d9-4f19-a9ed-ec543704584b tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:03:52 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_qy5gok61 Nov 03 13:03:52 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f5eae04-34d9-4f19-a9ed-ec543704584b tempest-VolumesActionsTest-1852279345 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:03:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1f5eae04-34d9-4f19-a9ed-ec543704584b tempest-VolumesActionsTest-1852279345 None] Detaching volume dc1e33b1-b617-47f7-82d7-fe08038a106c from instance 141e09a7-5bc0-4230-ab62-7369b30ef8d9. Nov 03 13:03:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1f5eae04-34d9-4f19-a9ed-ec543704584b tempest-VolumesActionsTest-1852279345 None] Detach volume completed successfully. Nov 03 13:03:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f5eae04-34d9-4f19-a9ed-ec543704584b tempest-VolumesActionsTest-1852279345 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:03:53 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_qy5gok61" returned: 0 in 0.553s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_qy5gok61 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9545da3d-3ee0-4b41-a4d7-690400ce4c80 tempest-VolumesActionsTest-301914732 None] Acquiring lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9545da3d-3ee0-4b41-a4d7-690400ce4c80 tempest-VolumesActionsTest-301914732 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:03:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9545da3d-3ee0-4b41-a4d7-690400ce4c80 tempest-VolumesActionsTest-301914732 None] Volume detach called, but volume not attached. Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9545da3d-3ee0-4b41-a4d7-690400ce4c80 tempest-VolumesActionsTest-301914732 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:03:53 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_qy5gok61 Nov 03 13:03:53 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:53 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_qy5gok61" returned: 1 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_qy5gok61' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[01652673-4bd7-4a99-b18c-cab008aed548]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Acquiring lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:03:53 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD Nov 03 13:03:53 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:03:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Acquiring lock "cinder-quobyte-dc1e33b1-b617-47f7-82d7-fe08038a106c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:03:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Lock "cinder-quobyte-dc1e33b1-b617-47f7-82d7-fe08038a106c" acquired by "delete_volume" :: waited 0.056s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:03:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1955edf0-3868-419c-acf7-2e9c269e2b66]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:03:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:54 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:54 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] 68321eb5-d635-47b3-850b-90ed52040d26 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:03:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:54 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 Nov 03 13:03:54 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:54 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c Nov 03 13:03:54 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:55 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c" returned: 0 in 0.915s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:55 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c Nov 03 13:03:55 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:55 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dc1e33b1-b617-47f7-82d7-fe08038a106c" returned: 0 in 0.588s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Lock "cinder-quobyte-dc1e33b1-b617-47f7-82d7-fe08038a106c" released by "delete_volume" :: held 1.716s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:03:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Created reservations ['4b884ba5-c905-4d27-a412-ecd5d734d7f2', 'bf49da06-cb01-4027-b1c9-a3caea4f6c5c', '2780f32f-0189-49c5-a743-7df6586abc61', 'b28b9a2b-6e4b-4984-8477-19d925e40edb'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:56 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:03:56 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:56 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.534s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:03:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Deleted volume successfully. Nov 03 13:03:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c88a144d-ae00-4cdc-ba3c-c81c97f98cab tempest-VolumesActionsTest-301914732 None] Lock "cinder-dc1e33b1-b617-47f7-82d7-fe08038a106c-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:03:57 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049" returned: 0 in 3.223s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_cpt2538kdevstack@QuobyteHD, size 112.00 MB, duration 3.22 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:03:57 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Converted 112.00 MB image at 34.74 MB/s Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:57 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 1G Nov 03 13:03:57 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:57 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 1G" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Downloaded image 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 6ca90e4d-185d-4f24-bf68-956f2335c049 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 for user 6bcad58f0c304e7fae8998cfa711f392 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Marking volume 6ca90e4d-185d-4f24-bf68-956f2335c049 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Copying metadata from image 68321eb5-d635-47b3-850b-90ed52040d26 to 6ca90e4d-185d-4f24-bf68-956f2335c049. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:03:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Creating volume glance metadata for volume 6ca90e4d-185d-4f24-bf68-956f2335c049 backed by image 68321eb5-d635-47b3-850b-90ed52040d26 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537f1c1e-e956-4397-bf7f-638a8f58e366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca90e4d-185d-4f24-bf68-956f2335c049', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04caa15-31a8-4415-a322-4b8c2e947981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:03:58 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Volume volume-6ca90e4d-185d-4f24-bf68-956f2335c049 (6ca90e4d-185d-4f24-bf68-956f2335c049): created successfully Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04caa15-31a8-4415-a322-4b8c2e947981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Flow 'volume_create_manager' (adc9fcbb-3ccf-4c4d-a1b6-508eb7ec6f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:03:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5b609787-445d-4490-a14d-b4512c1e2cbe tempest-TestShelveInstance-763283389 None] Created volume successfully. Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:03:58 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:03:58 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:03:58 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:03:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (e1aff742-0d37-44e5-9b39-b9222c75ddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e6080c-3bb5-4e9b-be3a-d096b45e369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e6080c-3bb5-4e9b-be3a-d096b45e369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-593009549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:00Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a500db6f-3abf-4efb-8001-5cf4d05494d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a500db6f-3abf-4efb-8001-5cf4d05494d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7ba752-8533-4212-ab72-6c7e171d28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7ba752-8533-4212-ab72-6c7e171d28ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0', 'volume_name': 'volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8426da-d30c-411d-abce-b6846b7d7e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8426da-d30c-411d-abce-b6846b7d7e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f50aa8-bc44-428f-82b6-82f52b12caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Volume 2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0', 'volume_size': 1} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-593009549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:00Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Creating volume 2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:00 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:00 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 1073741824 Nov 03 13:04:00 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:00 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 1073741824" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:00 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 Nov 03 13:04:00 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:01 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f50aa8-bc44-428f-82b6-82f52b12caf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c16708-6e6b-463e-b81d-2ec18247b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:01 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Volume volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 (2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0): created successfully Nov 03 13:04:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c16708-6e6b-463e-b81d-2ec18247b46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (e1aff742-0d37-44e5-9b39-b9222c75ddad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4be38ff8-ab7b-4182-8492-c9b7b6e6f4e9 tempest-VolumesActionsTest-301914732 None] Created volume successfully. Nov 03 13:04:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-quobyte-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ab9c01-df69-42fe-9a50-62d606a96aae]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:02 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 Nov 03 13:04:02 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:03 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0" returned: 0 in 0.536s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:03 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0 Nov 03 13:04:03 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:03 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0" returned: 0 in 0.314s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0" released by "delete_volume" :: held 0.924s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Created reservations ['c8343289-2d16-4d36-83ea-e151eb7637f4', '4f315b87-9573-4749-8fa0-ff03b4037077', 'dc7d7ddd-f911-4cc2-87c4-aa29c5e5942e', '78b6e685-e9cc-4d05-8e5f-5c3601eab62a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:03 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:03 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:04 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Deleted volume successfully. Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e288b64-7fed-42b3-bba5-63a2b38872d1 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-2e36b4e5-5e0f-4273-837b-f1c0fe31f4a0-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6c06e8df-bcf5-4831-b12a-066b90397a65 req-0382466f-8ac2-4ae6-b124-7df9e317c8cf tempest-TestShelveInstance-763283389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6c06e8df-bcf5-4831-b12a-066b90397a65 req-0382466f-8ac2-4ae6-b124-7df9e317c8cf tempest-TestShelveInstance-763283389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6c06e8df-bcf5-4831-b12a-066b90397a65 req-0382466f-8ac2-4ae6-b124-7df9e317c8cf tempest-TestShelveInstance-763283389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (68563b49-0ab0-43ec-8a9e-07d857598252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7696f6d0-ef32-4895-b671-c736d8f23169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7696f6d0-ef32-4895-b671-c736d8f23169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1620607413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f19f02-5a77-4ee1-ba9f-db455cb65568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:05Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8167b5a9-4263-458a-8ff4-dffdb7a05271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8167b5a9-4263-458a-8ff4-dffdb7a05271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5489aebe-04a8-4c99-9372-4ac0f768de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5489aebe-04a8-4c99-9372-4ac0f768de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f19f02-5a77-4ee1-ba9f-db455cb65568', 'volume_name': 'volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cdfaa2-16c3-4db4-ba1c-dd76cf6c0dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cdfaa2-16c3-4db4-ba1c-dd76cf6c0dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73331e37-011e-44ef-85d7-6a5b6d199991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Volume a0f19f02-5a77-4ee1-ba9f-db455cb65568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568', 'volume_size': 1} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1620607413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f19f02-5a77-4ee1-ba9f-db455cb65568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:05Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Creating volume a0f19f02-5a77-4ee1-ba9f-db455cb65568 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:05 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 1073741824 Nov 03 13:04:05 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6c06e8df-bcf5-4831-b12a-066b90397a65 req-0382466f-8ac2-4ae6-b124-7df9e317c8cf tempest-TestShelveInstance-763283389 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-6ca90e4d-185d-4f24-bf68-956f2335c049', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a8eaab9-a765-4075-9fcd-b76989e17bdd', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:04:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-6c06e8df-bcf5-4831-b12a-066b90397a65 req-0382466f-8ac2-4ae6-b124-7df9e317c8cf tempest-TestShelveInstance-763283389 None] attachment_update completed successfully. Nov 03 13:04:05 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 1073741824" returned: 0 in 0.819s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:05 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 Nov 03 13:04:05 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:06 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73331e37-011e-44ef-85d7-6a5b6d199991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303bb487-c02a-4cce-a37b-39aeba4e7022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Volume volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 (a0f19f02-5a77-4ee1-ba9f-db455cb65568): created successfully Nov 03 13:04:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303bb487-c02a-4cce-a37b-39aeba4e7022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (68563b49-0ab0-43ec-8a9e-07d857598252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-28c54d53-a939-45e9-85b2-52bc5315e2dd tempest-VolumesActionsTest-301914732 None] Created volume successfully. Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-a0f19f02-5a77-4ee1-ba9f-db455cb65568-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-a0f19f02-5a77-4ee1-ba9f-db455cb65568-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-quobyte-a0f19f02-5a77-4ee1-ba9f-db455cb65568" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-a0f19f02-5a77-4ee1-ba9f-db455cb65568" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c45d759-86f2-4178-89eb-3d4d2e442edd]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:07 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 Nov 03 13:04:07 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:07 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:07 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568 Nov 03 13:04:07 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:08 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a0f19f02-5a77-4ee1-ba9f-db455cb65568" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-a0f19f02-5a77-4ee1-ba9f-db455cb65568" released by "delete_volume" :: held 0.760s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Created reservations ['5574d641-0765-4d2d-a607-580a0f5f82a4', 'a1f2ab33-4d17-4708-8471-3c53cebe770f', 'a7536b0b-9a8d-44bf-bb35-4f5376ac0933', '332946fc-3736-42ad-af8b-0b7c1fdbb408'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:08 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:08 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:08 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Deleted volume successfully. Nov 03 13:04:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-21abf8ee-7ba0-45a2-a384-e66a733c9878 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-a0f19f02-5a77-4ee1-ba9f-db455cb65568-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (61d74491-2914-4e4c-b426-4d8dbdf4552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a066c34e-1c4d-45b4-af9f-dc9bd3c8cf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a066c34e-1c4d-45b4-af9f-dc9bd3c8cf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1730310437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f56e8c8-c1e6-4864-9e11-182744d6c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:10Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dd38fa-65ee-4379-8011-c5ccd397cb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dd38fa-65ee-4379-8011-c5ccd397cb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b654e52c-474f-47d4-b1e9-d065739b0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b654e52c-474f-47d4-b1e9-d065739b0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f56e8c8-c1e6-4864-9e11-182744d6c423', 'volume_name': 'volume-2f56e8c8-c1e6-4864-9e11-182744d6c423', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9961b6-b09c-41c0-b184-e269ccc73bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9961b6-b09c-41c0-b184-e269ccc73bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c84289-af97-4d66-82e9-3f9a7399c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Volume 2f56e8c8-c1e6-4864-9e11-182744d6c423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f56e8c8-c1e6-4864-9e11-182744d6c423', 'volume_size': 1} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1730310437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f56e8c8-c1e6-4864-9e11-182744d6c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:10Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Creating volume 2f56e8c8-c1e6-4864-9e11-182744d6c423 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:09 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:09 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 1073741824 Nov 03 13:04:09 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:10 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 1073741824" returned: 0 in 0.944s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:10 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 Nov 03 13:04:10 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423" returned: 0 in 0.626s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:11 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c84289-af97-4d66-82e9-3f9a7399c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f56e8c8-c1e6-4864-9e11-182744d6c423', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087f4ace-3384-49a2-b199-6c8c891fb235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Volume volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 (2f56e8c8-c1e6-4864-9e11-182744d6c423): created successfully Nov 03 13:04:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087f4ace-3384-49a2-b199-6c8c891fb235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (61d74491-2914-4e4c-b426-4d8dbdf4552d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-66de7470-cf85-43a7-b214-d70f2fd32ccc tempest-VolumesActionsTest-301914732 None] Created volume successfully. Nov 03 13:04:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-2f56e8c8-c1e6-4864-9e11-182744d6c423-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Lock "cinder-2f56e8c8-c1e6-4864-9e11-182744d6c423-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-quobyte-2f56e8c8-c1e6-4864-9e11-182744d6c423" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-2f56e8c8-c1e6-4864-9e11-182744d6c423" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c26fd52-3105-44f5-9b5c-561a81adfde2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:12 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 Nov 03 13:04:12 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:13 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423" returned: 0 in 0.751s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:13 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423 Nov 03 13:04:13 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:13 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f56e8c8-c1e6-4864-9e11-182744d6c423" returned: 0 in 0.480s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-2f56e8c8-c1e6-4864-9e11-182744d6c423" released by "delete_volume" :: held 1.457s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:13 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Created reservations ['afc1fe8e-1659-4543-b1a7-dd9300dba888', 'f63d10d0-c048-4e88-bb7b-8cecdd9b93bb', '2e8aff3a-f4a8-44dc-8192-a36cd32aafcf', 'b5d2ad3f-6763-4b9b-8117-d4459ed8ede4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:14 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:14 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Flow 'volume_create_manager' (eb43ee5e-bae3-4b5c-a0b1-8f2a840a4176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42830dc-9792-447d-b7b3-ff35e9ac6c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42830dc-9792-447d-b7b3-ff35e9ac6c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1201670e-ce8d-4eb1-bc08-fb8d743e02ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a61c7ece07f4a9eaf4e78e0be57dcab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:14Z,use_quota=True,user_id='f83762a26c1c4512bf7d57c2c4339df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecc613f-5f84-4c52-8973-81e239de00b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecc613f-5f84-4c52-8973-81e239de00b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e0a5b8-835c-49a9-af1b-51b6ba3aa995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e0a5b8-835c-49a9-af1b-51b6ba3aa995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1201670e-ce8d-4eb1-bc08-fb8d743e02ac', 'volume_name': 'volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a86bb8-4389-465e-8824-76e0c99a83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a86bb8-4389-465e-8824-76e0c99a83c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0976b023-ba98-41d5-a8b4-2e0e5da06eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Volume 1201670e-ce8d-4eb1-bc08-fb8d743e02ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac', 'volume_size': 1} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1201670e-ce8d-4eb1-bc08-fb8d743e02ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a61c7ece07f4a9eaf4e78e0be57dcab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:14Z,use_quota=True,user_id='f83762a26c1c4512bf7d57c2c4339df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Creating volume 1201670e-ce8d-4eb1-bc08-fb8d743e02ac {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:14 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:14 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac 1073741824 Nov 03 13:04:14 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.684s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Deleted volume successfully. Nov 03 13:04:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b386099-fc5e-4fd4-b980-81997f7040ef tempest-VolumesActionsTest-1852279345 None] Lock "cinder-2f56e8c8-c1e6-4864-9e11-182744d6c423-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:15 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac 1073741824" returned: 0 in 1.224s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (72e74fe3-6357-436f-a014-ad35f546a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d716ee-3807-48b3-913e-265088b2d638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:16 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac Nov 03 13:04:16 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d716ee-3807-48b3-913e-265088b2d638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1536718483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955d05a0-c53c-4e52-b53d-2b2b3c465c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:16Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed6d3ef-b3ce-45ac-93ca-e9fbf744b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed6d3ef-b3ce-45ac-93ca-e9fbf744b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57259635-37c8-4d95-86d6-a9eaf029dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57259635-37c8-4d95-86d6-a9eaf029dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955d05a0-c53c-4e52-b53d-2b2b3c465c2a', 'volume_name': 'volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6710440a-79be-4ae2-bb81-16c1d259437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6710440a-79be-4ae2-bb81-16c1d259437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f955069-9086-440f-9f17-01c2f5740ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Volume 955d05a0-c53c-4e52-b53d-2b2b3c465c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a', 'volume_size': 1} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:16 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac" returned: 0 in 0.545s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1536718483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955d05a0-c53c-4e52-b53d-2b2b3c465c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:16Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Creating volume 955d05a0-c53c-4e52-b53d-2b2b3c465c2a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0976b023-ba98-41d5-a8b4-2e0e5da06eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:16 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a 1073741824 Nov 03 13:04:16 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c8111c-fcdf-4c8b-92ef-d6a4345e9cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Volume volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac (1201670e-ce8d-4eb1-bc08-fb8d743e02ac): created successfully Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c8111c-fcdf-4c8b-92ef-d6a4345e9cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Flow 'volume_create_manager' (eb43ee5e-bae3-4b5c-a0b1-8f2a840a4176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ec2fbf8d-7516-4bb0-8908-dad910d5cf3c tempest-CinderUnicodeTest-1921582326 None] Created volume successfully. Nov 03 13:04:17 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a 1073741824" returned: 0 in 1.093s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:17 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a Nov 03 13:04:17 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:18 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a" returned: 0 in 0.668s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f955069-9086-440f-9f17-01c2f5740ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893b7bcd-cb10-4b5f-a268-342c51b6b71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Volume volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a (955d05a0-c53c-4e52-b53d-2b2b3c465c2a): created successfully Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893b7bcd-cb10-4b5f-a268-342c51b6b71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (72e74fe3-6357-436f-a014-ad35f546a195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0ef32bce-0c29-443f-bfb6-c31994330592 tempest-VolumesActionsTest-301914732 None] Created volume successfully. Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Flow 'volume_create_manager' (bedce679-2053-4ff1-86af-792906e6d9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09346032-7aaf-4a5a-9ba5-6d4a0f812b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09346032-7aaf-4a5a-9ba5-6d4a0f812b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1168682314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b364a7e-838e-4333-b563-fece2eb59b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a61c7ece07f4a9eaf4e78e0be57dcab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:19Z,use_quota=True,user_id='f83762a26c1c4512bf7d57c2c4339df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756bafcb-8942-4ec0-97c7-6c2309158ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756bafcb-8942-4ec0-97c7-6c2309158ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8909a04-4749-4461-8d1b-6d78860eaf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8909a04-4749-4461-8d1b-6d78860eaf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b364a7e-838e-4333-b563-fece2eb59b88', 'volume_name': 'volume-2b364a7e-838e-4333-b563-fece2eb59b88', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec7c2ff-8c2d-4a87-9bce-70fdf5ac9ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec7c2ff-8c2d-4a87-9bce-70fdf5ac9ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ff6411-acce-4db4-b93a-aa185d20f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Volume 2b364a7e-838e-4333-b563-fece2eb59b88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b364a7e-838e-4333-b563-fece2eb59b88', 'volume_size': 1} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1168682314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b364a7e-838e-4333-b563-fece2eb59b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a61c7ece07f4a9eaf4e78e0be57dcab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:19Z,use_quota=True,user_id='f83762a26c1c4512bf7d57c2c4339df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Creating volume 2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:18 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 1073741824 Nov 03 13:04:18 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-955d05a0-c53c-4e52-b53d-2b2b3c465c2a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:19 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 1073741824" returned: 0 in 1.099s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-955d05a0-c53c-4e52-b53d-2b2b3c465c2a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:20 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 Nov 03 13:04:20 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "cinder-quobyte-955d05a0-c53c-4e52-b53d-2b2b3c465c2a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-955d05a0-c53c-4e52-b53d-2b2b3c465c2a" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bea2f6a-9b9f-4a71-8323-967f323455db]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:20 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a Nov 03 13:04:20 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:20 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88" returned: 0 in 0.946s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ff6411-acce-4db4-b93a-aa185d20f08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b364a7e-838e-4333-b563-fece2eb59b88', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ff1829-486e-4984-abfd-00ec69212c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Volume volume-2b364a7e-838e-4333-b563-fece2eb59b88 (2b364a7e-838e-4333-b563-fece2eb59b88): created successfully Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ff1829-486e-4984-abfd-00ec69212c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Flow 'volume_create_manager' (bedce679-2053-4ff1-86af-792906e6d9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2388a096-cd64-419e-852f-f721a80e21c2 tempest-CinderUnicodeTest-1921582326 None] Created volume successfully. Nov 03 13:04:21 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a" returned: 0 in 0.861s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:21 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a Nov 03 13:04:21 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:21 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-955d05a0-c53c-4e52-b53d-2b2b3c465c2a" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-quobyte-955d05a0-c53c-4e52-b53d-2b2b3c465c2a" released by "delete_volume" :: held 1.323s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Created reservations ['b7e248c4-e53b-4ae7-a9a7-022bf1276854', '52794324-6c23-4fec-8cef-70f5ee38e32d', 'a37a894e-b4da-42f5-8490-654c5f613141', 'c2695cc1-4a4d-42ec-9cf5-52ef4b998ea3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:21 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:21 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:21 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Deleted volume successfully. Nov 03 13:04:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ecba96f-0089-47b9-b4bd-585291276d05 tempest-VolumesActionsTest-1852279345 None] Lock "cinder-955d05a0-c53c-4e52-b53d-2b2b3c465c2a-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Creating offline snapshot 39792bdd-bdbc-430a-8ec9-b7380b2b0b21 of volume 2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:04:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[63735f77-9aa8-443a-9859-49dae3198254]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:22 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 Nov 03 13:04:22 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:22 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88" returned: 0 in 0.495s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:22 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 1G Nov 03 13:04:22 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (0ff918d6-1e13-4683-ad3f-fc440287df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231405e1-63a3-4482-befa-1260eb30cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231405e1-63a3-4482-befa-1260eb30cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1650635228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a83188a-c37a-41fd-aa89-2ad4eef324f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:23Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c2a73f-30c1-48a9-ac86-d22ab62c7b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c2a73f-30c1-48a9-ac86-d22ab62c7b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc48842-8302-4a89-8d2c-84315a5b8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc48842-8302-4a89-8d2c-84315a5b8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a83188a-c37a-41fd-aa89-2ad4eef324f7', 'volume_name': 'volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628a1b64-c564-45ef-82b6-806fbac8f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628a1b64-c564-45ef-82b6-806fbac8f428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39f5962-f9b6-4bb7-919d-5ed088106881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Volume 1a83188a-c37a-41fd-aa89-2ad4eef324f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7', 'volume_size': 1} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:23 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 1G" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b364a7e-838e-4333-b563-fece2eb59b88 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:23 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b364a7e-838e-4333-b563-fece2eb59b88 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 Nov 03 13:04:23 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:23 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b364a7e-838e-4333-b563-fece2eb59b88 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 is being set with open permissions: ugo+rw Nov 03 13:04:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:23 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 Nov 03 13:04:23 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:24 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:24 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.info Nov 03 13:04:24 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:24 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.info" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:24 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.info is being set with open permissions: ugo+rw Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:24 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.info Nov 03 13:04:24 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:24 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.info" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1650635228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a83188a-c37a-41fd-aa89-2ad4eef324f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09198e630d1947a7b198030ea655896f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:23Z,use_quota=True,user_id='fc75493ccdf14c9693faa17368311be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Creating volume 1a83188a-c37a-41fd-aa89-2ad4eef324f7 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:24 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:24 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 1073741824 Nov 03 13:04:24 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5b33bb6a-fce4-4261-8345-43e2b2ac6f1d tempest-CinderUnicodeTest-1921582326 None] Create snapshot completed successfully Nov 03 13:04:25 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 1073741824" returned: 0 in 0.496s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:25 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 Nov 03 13:04:25 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:25 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39f5962-f9b6-4bb7-919d-5ed088106881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b02d156-58ac-4e49-bf1e-414386d08def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Volume volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 (1a83188a-c37a-41fd-aa89-2ad4eef324f7): created successfully Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b02d156-58ac-4e49-bf1e-414386d08def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Flow 'volume_create_manager' (0ff918d6-1e13-4683-ad3f-fc440287df8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a0715fbd-f37d-4844-b6f1-2dd107afbfe2 tempest-VolumesActionsTest-301914732 None] Created volume successfully. Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "cinder-39792bdd-bdbc-430a-8ec9-b7380b2b0b21-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-39792bdd-bdbc-430a-8ec9-b7380b2b0b21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "cinder-quobyte-2b364a7e-838e-4333-b563-fece2eb59b88" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-2b364a7e-838e-4333-b563-fece2eb59b88" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "cinder-quobyte-39792bdd-bdbc-430a-8ec9-b7380b2b0b21" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-39792bdd-bdbc-430a-8ec9-b7380b2b0b21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Deleting offline snapshot 39792bdd-bdbc-430a-8ec9-b7380b2b0b21 of volume 2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] snapshot_file for this snap is: volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[81507c6c-9f85-4358-b201-68b96af9bf10]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:25 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 Nov 03 13:04:25 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:26 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21" returned: 0 in 0.372s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b364a7e-838e-4333-b563-fece2eb59b88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:04:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee42aeca-9689-438c-b505-b693aec16f9f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:26 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 Nov 03 13:04:26 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:26 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88" returned: 0 in 0.524s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:26 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 Nov 03 13:04:26 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Acquiring lock "cinder-1a83188a-c37a-41fd-aa89-2ad4eef324f7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:27 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Lock "cinder-1a83188a-c37a-41fd-aa89-2ad4eef324f7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:27 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21 Nov 03 13:04:27 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Acquiring lock "cinder-quobyte-1a83188a-c37a-41fd-aa89-2ad4eef324f7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Lock "cinder-quobyte-1a83188a-c37a-41fd-aa89-2ad4eef324f7" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca47248a-2049-4edd-8f9e-434d336a6ed1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:27 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 Nov 03 13:04:27 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:27 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88.39792bdd-bdbc-430a-8ec9-b7380b2b0b21" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-39792bdd-bdbc-430a-8ec9-b7380b2b0b21" released by "_delete_snapshot" :: held 1.856s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-2b364a7e-838e-4333-b563-fece2eb59b88" released by "delete_snapshot" :: held 1.885s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Created reservations ['bf232b2b-ab28-4fc8-898b-c735a374b911', '99d2988f-4ebf-4bf7-87b1-bc7f9236783b', '9113cfca-cc64-4ca9-9a42-47ad4bbeb9e4', '049a91af-86f3-4186-aa75-870e632a8b02'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Delete snapshot completed successfully. Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb9b1216-9726-4a66-a427-cb1ed6d73f04 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-39792bdd-bdbc-430a-8ec9-b7380b2b0b21-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:27 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7" returned: 0 in 0.515s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:27 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7 Nov 03 13:04:27 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "cinder-2b364a7e-838e-4333-b563-fece2eb59b88-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-2b364a7e-838e-4333-b563-fece2eb59b88-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "cinder-quobyte-2b364a7e-838e-4333-b563-fece2eb59b88" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-2b364a7e-838e-4333-b563-fece2eb59b88" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8fff33-0697-4fc7-9484-d2b00b133a2a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:28 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1a83188a-c37a-41fd-aa89-2ad4eef324f7" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Lock "cinder-quobyte-1a83188a-c37a-41fd-aa89-2ad4eef324f7" released by "delete_volume" :: held 0.957s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:28 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 Nov 03 13:04:28 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Created reservations ['c8c8566d-10c2-4951-8bc1-5165721707ac', 'b4c20a2c-67b5-44ab-9db1-ee6a47ee1910', 'e306c434-cc99-46c4-a9aa-036f0f5ff59a', '1f448dbe-c2f9-4877-950a-55c8ab5563af'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:28 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:28 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:28 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:28 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88 Nov 03 13:04:28 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:28 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Deleted volume successfully. Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-10461354-f7a2-4315-8ca0-66445dd6f3da tempest-VolumesActionsTest-301914732 None] Lock "cinder-1a83188a-c37a-41fd-aa89-2ad4eef324f7-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:28 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2b364a7e-838e-4333-b563-fece2eb59b88" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-2b364a7e-838e-4333-b563-fece2eb59b88" released by "delete_volume" :: held 0.870s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Created reservations ['633b0a38-982a-48dc-b465-0a43ac7e2b44', '12deebd8-ec5f-4ce7-927c-4163093c4bc6', '1176d105-cc61-45b5-995f-4e5b5d705127', '4612bc65-8df5-4280-a1e6-c4ae22e7e9cf'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:29 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:29 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "cinder-1201670e-ce8d-4eb1-bc08-fb8d743e02ac-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-1201670e-ce8d-4eb1-bc08-fb8d743e02ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "cinder-quobyte-1201670e-ce8d-4eb1-bc08-fb8d743e02ac" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-1201670e-ce8d-4eb1-bc08-fb8d743e02ac" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce6e75-6326-43c9-b658-6c9b454f6321]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:29 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac Nov 03 13:04:29 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:29 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Deleted volume successfully. Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-09972446-0bbc-4294-baf1-7f9f18a47457 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-2b364a7e-838e-4333-b563-fece2eb59b88-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:29 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac" returned: 0 in 0.438s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:29 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac Nov 03 13:04:29 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:29 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1201670e-ce8d-4eb1-bc08-fb8d743e02ac" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-quobyte-1201670e-ce8d-4eb1-bc08-fb8d743e02ac" released by "delete_volume" :: held 0.756s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Created reservations ['9194162d-3090-42cd-9693-954ed6e5e5c4', '8429dc72-8432-430b-82a8-7282ab8121ab', 'cca7fc26-1e8e-4622-b7c8-4efb880f7008', '32c20ea4-9adc-412d-bf9c-156e0cb26d3b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:30 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:30 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:30 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Deleted volume successfully. Nov 03 13:04:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f330910b-3f4a-4304-a9f0-ebc353654c12 tempest-CinderUnicodeTest-1921582326 None] Lock "cinder-1201670e-ce8d-4eb1-bc08-fb8d743e02ac-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Flow 'volume_create_manager' (0d348f14-12ee-4004-9f3c-a150e6c78416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f344642b-d5e5-421a-8cd6-94871bff924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f344642b-d5e5-421a-8cd6-94871bff924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-786699048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b4a64d-cf63-4bb6-88c8-3700e33a2fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a548c1af81c4fc79bc311b8c5c42206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:35Z,use_quota=True,user_id='500f1d06f079404280f3e17282d7394e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9e74a0-a01e-415c-9d91-ac18aaae0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9e74a0-a01e-415c-9d91-ac18aaae0a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2fd98d-150b-4365-b7dd-663cc601130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2fd98d-150b-4365-b7dd-663cc601130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b4a64d-cf63-4bb6-88c8-3700e33a2fde', 'volume_name': 'volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d621f79f-2d2f-49f6-89ff-0d48f3f3c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d621f79f-2d2f-49f6-89ff-0d48f3f3c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81a7d6-b94b-474d-9157-e50e23ee262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Volume 61b4a64d-cf63-4bb6-88c8-3700e33a2fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde', 'volume_size': 1} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-786699048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b4a64d-cf63-4bb6-88c8-3700e33a2fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a548c1af81c4fc79bc311b8c5c42206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:35Z,use_quota=True,user_id='500f1d06f079404280f3e17282d7394e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Creating volume 61b4a64d-cf63-4bb6-88c8-3700e33a2fde {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:34 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde 1073741824 Nov 03 13:04:34 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:35 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde 1073741824" returned: 0 in 0.547s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:35 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde Nov 03 13:04:35 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:35 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81a7d6-b94b-474d-9157-e50e23ee262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02296c2-b780-41c5-97f1-3cfd2920f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Volume volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde (61b4a64d-cf63-4bb6-88c8-3700e33a2fde): created successfully Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02296c2-b780-41c5-97f1-3cfd2920f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Flow 'volume_create_manager' (0d348f14-12ee-4004-9f3c-a150e6c78416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-acb2a2d8-9b01-4261-b07e-9005a3ea63ec tempest-ProjectReaderTests-629520743 None] Created volume successfully. Nov 03 13:04:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Acquiring lock "cinder-61b4a64d-cf63-4bb6-88c8-3700e33a2fde-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Lock "cinder-61b4a64d-cf63-4bb6-88c8-3700e33a2fde-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Acquiring lock "cinder-quobyte-61b4a64d-cf63-4bb6-88c8-3700e33a2fde" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Lock "cinder-quobyte-61b4a64d-cf63-4bb6-88c8-3700e33a2fde" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c213c80-fe9a-4ba1-8a79-dcde5c665b58]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:37 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde Nov 03 13:04:37 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:37 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:37 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde Nov 03 13:04:37 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:37 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-61b4a64d-cf63-4bb6-88c8-3700e33a2fde" returned: 0 in 0.243s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Lock "cinder-quobyte-61b4a64d-cf63-4bb6-88c8-3700e33a2fde" released by "delete_volume" :: held 0.660s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Created reservations ['d529b0c1-79c1-4c80-a859-09fef9f08e25', 'f1af4754-f84b-4c57-ab00-3c278c771340', '1a84f859-0132-434a-b73d-5a9c51b61e1d', '6e1252f5-a7e5-4f54-8359-fd8b5d8d91dd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:37 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:37 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:38 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Deleted volume successfully. Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e3f67dc-c987-4aac-b523-438194c52503 tempest-ProjectReaderTests-629520743 None] Lock "cinder-61b4a64d-cf63-4bb6-88c8-3700e33a2fde-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Flow 'volume_create_manager' (b5b37618-7c78-41f1-984e-0d8f266192ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cd3c07-1c56-4bb1-a1a7-06cda6312dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cd3c07-1c56-4bb1-a1a7-06cda6312dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848295480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a9be21-27d5-4fc8-bb61-fd27acf2bdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a548c1af81c4fc79bc311b8c5c42206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:39Z,use_quota=True,user_id='500f1d06f079404280f3e17282d7394e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d14eeb-6ba3-4aed-be2a-5231cb2d16cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d14eeb-6ba3-4aed-be2a-5231cb2d16cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57f4658-50ec-4301-be5c-adb3026cfc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57f4658-50ec-4301-be5c-adb3026cfc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a9be21-27d5-4fc8-bb61-fd27acf2bdd6', 'volume_name': 'volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efae65f-70ec-44fd-a848-cc4f62cdf96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efae65f-70ec-44fd-a848-cc4f62cdf96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794e3eb5-261b-4260-980b-5013c4bd2585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Volume 72a9be21-27d5-4fc8-bb61-fd27acf2bdd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6', 'volume_size': 1} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848295480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a9be21-27d5-4fc8-bb61-fd27acf2bdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a548c1af81c4fc79bc311b8c5c42206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:39Z,use_quota=True,user_id='500f1d06f079404280f3e17282d7394e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Creating volume 72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:39 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 1073741824 Nov 03 13:04:39 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Flow 'volume_create_manager' (5f6f3611-747f-427e-abad-d455bf8ef55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713cebcf-6154-4379-9d7e-4e2bf768a9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713cebcf-6154-4379-9d7e-4e2bf768a9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1709231455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b277751b-f3f1-44f9-b424-0867a81357c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d559683d1b3644c4ae68789801aed69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:39Z,use_quota=True,user_id='e4732bfcb5594cf993c82ff7ca130933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe8eaf8-754e-4fd0-8455-1b1e6ce7c943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe8eaf8-754e-4fd0-8455-1b1e6ce7c943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37c7cd4-1c60-4000-92fd-1da4d63a9b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37c7cd4-1c60-4000-92fd-1da4d63a9b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b277751b-f3f1-44f9-b424-0867a81357c0', 'volume_name': 'volume-b277751b-f3f1-44f9-b424-0867a81357c0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b40a10f-5358-43ac-8797-9a5ee64ac958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b40a10f-5358-43ac-8797-9a5ee64ac958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b21ec2-a03c-4b60-8f0c-0c0fd6b47beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Volume b277751b-f3f1-44f9-b424-0867a81357c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b277751b-f3f1-44f9-b424-0867a81357c0', 'volume_size': 1} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:39 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 1073741824" returned: 0 in 0.603s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:39 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 Nov 03 13:04:39 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:39 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1709231455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b277751b-f3f1-44f9-b424-0867a81357c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d559683d1b3644c4ae68789801aed69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:39Z,use_quota=True,user_id='e4732bfcb5594cf993c82ff7ca130933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Creating volume b277751b-f3f1-44f9-b424-0867a81357c0 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.046s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:39 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794e3eb5-261b-4260-980b-5013c4bd2585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e77083e-fd09-4bb9-afcc-6481956ea3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:40 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 1073741824 Nov 03 13:04:40 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:40 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Volume volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 (72a9be21-27d5-4fc8-bb61-fd27acf2bdd6): created successfully Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e77083e-fd09-4bb9-afcc-6481956ea3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Flow 'volume_create_manager' (b5b37618-7c78-41f1-984e-0d8f266192ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-db559f71-23d7-4131-b0ce-ddbab1e68830 tempest-ProjectReaderTests-629520743 None] Created volume successfully. Nov 03 13:04:40 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 1073741824" returned: 0 in 0.587s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:40 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 Nov 03 13:04:40 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:40 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Acquiring lock "cinder-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b21ec2-a03c-4b60-8f0c-0c0fd6b47beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b277751b-f3f1-44f9-b424-0867a81357c0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b1e76f-dbee-4122-9c89-f250902ee2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Lock "cinder-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:40 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Volume volume-b277751b-f3f1-44f9-b424-0867a81357c0 (b277751b-f3f1-44f9-b424-0867a81357c0): created successfully Nov 03 13:04:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b1e76f-dbee-4122-9c89-f250902ee2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Flow 'volume_create_manager' (5f6f3611-747f-427e-abad-d455bf8ef55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Acquiring lock "cinder-quobyte-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c9345fac-73f1-48b0-a952-d8f0da141e37 tempest-AttachVolumeNegativeTest-914678679 None] Created volume successfully. Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Lock "cinder-quobyte-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b10265-09ce-4863-a380-503bc2c743f3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:41 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 Nov 03 13:04:41 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:41 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:41 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6 Nov 03 13:04:41 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:41 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Lock "cinder-quobyte-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6" released by "delete_volume" :: held 0.880s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Created reservations ['57c6efb1-1e5d-4459-94a8-15a45f92428b', '4a3e9cd2-0780-4216-a90f-c39e09d3a1a6', 'ac99ea36-bd13-42b9-bef3-bfb5f1a75085', '616f12d0-10cb-4c55-90ab-891f3802015d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:42 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:42 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:42 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.550s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Deleted volume successfully. Nov 03 13:04:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-feecdfd8-cdc5-4d48-94de-564a979a46a2 tempest-ProjectReaderTests-629520743 None] Lock "cinder-72a9be21-27d5-4fc8-bb61-fd27acf2bdd6-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c126d4ea-3d6e-4778-ba7d-79d8e67a1600 req-dd9f374b-5f01-41e8-81b9-706dcd7ff02d tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c126d4ea-3d6e-4778-ba7d-79d8e67a1600 req-dd9f374b-5f01-41e8-81b9-706dcd7ff02d tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c126d4ea-3d6e-4778-ba7d-79d8e67a1600 req-dd9f374b-5f01-41e8-81b9-706dcd7ff02d tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c126d4ea-3d6e-4778-ba7d-79d8e67a1600 req-dd9f374b-5f01-41e8-81b9-706dcd7ff02d tempest-AttachVolumeNegativeTest-914678679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-b277751b-f3f1-44f9-b424-0867a81357c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbf0ee25-130d-4448-86f3-569ab73e8eb7', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:04:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c126d4ea-3d6e-4778-ba7d-79d8e67a1600 req-dd9f374b-5f01-41e8-81b9-706dcd7ff02d tempest-AttachVolumeNegativeTest-914678679 None] attachment_update completed successfully. Nov 03 13:04:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-9086e346-7efb-4dc2-89f5-7bbe2fcf4ccf req-8682ad4a-4511-492a-920a-fc804b1aca17 tempest-AttachVolumeNegativeTest-914678679 None] Terminate volume connection completed successfully. Nov 03 13:04:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-9086e346-7efb-4dc2-89f5-7bbe2fcf4ccf req-8682ad4a-4511-492a-920a-fc804b1aca17 tempest-AttachVolumeNegativeTest-914678679 None] Deleting attachment bbf0ee25-130d-4448-86f3-569ab73e8eb7. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:04:46 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=123,cinder:UPDATE=129,cinder:DELETE=11,cinder:INSERT=38 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:04:46 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=152,cinder:SELECT=125,cinder:INSERT=38,cinder:DELETE=13 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:04:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-6bf3f822-cc72-4c90-99df-2c6670b4b535 req-985c6c5e-29e4-42eb-ab06-c5a335263ab4 tempest-TestShelveInstance-763283389 None] Terminate volume connection completed successfully. Nov 03 13:04:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6bf3f822-cc72-4c90-99df-2c6670b4b535 req-985c6c5e-29e4-42eb-ab06-c5a335263ab4 tempest-TestShelveInstance-763283389 None] Deleting attachment 2a8eaab9-a765-4075-9fcd-b76989e17bdd. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:04:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "cinder-b277751b-f3f1-44f9-b424-0867a81357c0-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-b277751b-f3f1-44f9-b424-0867a81357c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "cinder-quobyte-b277751b-f3f1-44f9-b424-0867a81357c0" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-quobyte-b277751b-f3f1-44f9-b424-0867a81357c0" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d872ea-b60a-4add-bfcb-05c31ea48777]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:51 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 Nov 03 13:04:51 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-21dc1d6c-00f4-4bd4-8c8d-ef15f24fa4cb req-034dae37-e022-48dc-b100-df2e82dae6ef tempest-TestShelveInstance-763283389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-21dc1d6c-00f4-4bd4-8c8d-ef15f24fa4cb req-034dae37-e022-48dc-b100-df2e82dae6ef tempest-TestShelveInstance-763283389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:52 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0" returned: 0 in 0.480s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-21dc1d6c-00f4-4bd4-8c8d-ef15f24fa4cb req-034dae37-e022-48dc-b100-df2e82dae6ef tempest-TestShelveInstance-763283389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:52 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0 Nov 03 13:04:52 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-21dc1d6c-00f4-4bd4-8c8d-ef15f24fa4cb req-034dae37-e022-48dc-b100-df2e82dae6ef tempest-TestShelveInstance-763283389 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-6ca90e4d-185d-4f24-bf68-956f2335c049', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcf15cbf-8513-4f48-bf1a-b0f6b92339e4', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:04:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-21dc1d6c-00f4-4bd4-8c8d-ef15f24fa4cb req-034dae37-e022-48dc-b100-df2e82dae6ef tempest-TestShelveInstance-763283389 None] attachment_update completed successfully. Nov 03 13:04:52 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b277751b-f3f1-44f9-b424-0867a81357c0" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-quobyte-b277751b-f3f1-44f9-b424-0867a81357c0" released by "delete_volume" :: held 0.881s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Created reservations ['9b429678-ec09-4d2b-98ab-2a022605abcc', '0ce078e9-a2e7-4c7d-b9a4-8e1dc9144b5d', 'f8ef6640-bfbd-42a4-ad04-fa81883734b1', 'a3294ff6-5846-4946-b619-6a1c6f1b1a56'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:52 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:52 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "cinder-4fe4c848-b90d-4d90-92af-edf36e732e47-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-4fe4c848-b90d-4d90-92af-edf36e732e47-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "cinder-quobyte-4fe4c848-b90d-4d90-92af-edf36e732e47" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-quobyte-4fe4c848-b90d-4d90-92af-edf36e732e47" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac6f25-840a-4801-b7dc-84f90dad3b08]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:53 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.605s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Deleted volume successfully. Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-254ce6f1-6258-4389-a5a2-5e73c3797669 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-b277751b-f3f1-44f9-b424-0867a81357c0-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:53 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 Nov 03 13:04:53 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:53 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47" returned: 0 in 0.505s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:53 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47 Nov 03 13:04:53 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:53 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fe4c848-b90d-4d90-92af-edf36e732e47" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-quobyte-4fe4c848-b90d-4d90-92af-edf36e732e47" released by "delete_volume" :: held 0.868s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Created reservations ['e041aaa5-337e-49d8-a4b4-fcfdb90beeed', 'd518a2f6-55fa-43b4-a3ea-76b1f4ca2d85', '13e3bb1e-b5cc-485d-8681-5aafd1d6566e', '4e6da729-b900-41e5-af1e-418863179d70'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:54 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:54 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:54 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Deleted volume successfully. Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "cinder-afa8e8c3-d64f-41f1-830c-97d2285886a4-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-afa8e8c3-d64f-41f1-830c-97d2285886a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-906a7c26-2e44-4a1f-b638-debf076f25e6 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-4fe4c848-b90d-4d90-92af-edf36e732e47-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "cinder-quobyte-afa8e8c3-d64f-41f1-830c-97d2285886a4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-quobyte-afa8e8c3-d64f-41f1-830c-97d2285886a4" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ecff6-d0bd-459c-a833-a6e4ce1ed12d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:04:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:54 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 Nov 03 13:04:54 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:55 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4" returned: 0 in 0.447s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:55 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4 Nov 03 13:04:55 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:55 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-afa8e8c3-d64f-41f1-830c-97d2285886a4" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-quobyte-afa8e8c3-d64f-41f1-830c-97d2285886a4" released by "delete_volume" :: held 0.850s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Created reservations ['7361881f-ed40-4c03-9a53-fd7432a68524', '0ab7fbbe-1ad0-46c5-bdb1-a54329a269b1', '447dde26-da58-42bc-aab5-05da7fe05bb0', '34e17108-cc4d-4f5d-9c0a-3590f96cf2d3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:55 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:55 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:56 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.509s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:56 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Deleted volume successfully. Nov 03 13:04:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cec54571-ec6f-4a8d-a6fe-0c3de5c40c39 tempest-AttachVolumeNegativeTest-914678679 None] Lock "cinder-afa8e8c3-d64f-41f1-830c-97d2285886a4-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Flow 'volume_create_manager' (bc1c3e91-f650-4e60-bfbc-7609271340dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0be9ca-9378-4e23-8373-3a5c632fd5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0be9ca-9378-4e23-8373-3a5c632fd5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-676874098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09713edd-dd05-4d7d-8ce2-a22643b1cb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382f88f39c9c48349557e11ff984997e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:58Z,use_quota=True,user_id='5e6f738e796f4a62bddfd9cfb2936113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a974d014-8e4d-4e32-9687-077c561251a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a974d014-8e4d-4e32-9687-077c561251a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26ec7c5-b2bb-409b-9bf5-a51b8a9ded7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26ec7c5-b2bb-409b-9bf5-a51b8a9ded7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09713edd-dd05-4d7d-8ce2-a22643b1cb2e', 'volume_name': 'volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e603319f-0b0c-4b8f-89f3-8d57e50e6f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e603319f-0b0c-4b8f-89f3-8d57e50e6f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9c8822-18a3-4c00-8d1c-122eddad84c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:58 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Volume 09713edd-dd05-4d7d-8ce2-a22643b1cb2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e', 'volume_size': 1} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-676874098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09713edd-dd05-4d7d-8ce2-a22643b1cb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382f88f39c9c48349557e11ff984997e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:04:58Z,use_quota=True,user_id='5e6f738e796f4a62bddfd9cfb2936113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Creating volume 09713edd-dd05-4d7d-8ce2-a22643b1cb2e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:04:58 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:58 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e 1073741824 Nov 03 13:04:58 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:58 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:04:58 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:59 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e 1073741824" returned: 0 in 0.606s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:59 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:04:59 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e Nov 03 13:04:59 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:04:59 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e" returned: 0 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9c8822-18a3-4c00-8d1c-122eddad84c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f585427-cf16-42d8-8bf4-bb934e511e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:04:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Volume volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e (09713edd-dd05-4d7d-8ce2-a22643b1cb2e): created successfully Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f585427-cf16-42d8-8bf4-bb934e511e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:04:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Flow 'volume_create_manager' (bc1c3e91-f650-4e60-bfbc-7609271340dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:04:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1555291d-ab7d-4be1-89d4-7164d8c39d55 tempest-VolumesTransfersV355Test-1687926174 None] Created volume successfully. Nov 03 13:05:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3bdf8660-23fd-480f-86e6-5bf2544cbccf tempest-VolumesTransfersV355Test-546712922 None] Transfer volume completed successfully. Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Acquiring lock "cinder-09713edd-dd05-4d7d-8ce2-a22643b1cb2e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-09713edd-dd05-4d7d-8ce2-a22643b1cb2e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Acquiring lock "cinder-quobyte-09713edd-dd05-4d7d-8ce2-a22643b1cb2e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-quobyte-09713edd-dd05-4d7d-8ce2-a22643b1cb2e" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43287fc-9ad7-4f13-aecf-c21f54d3533e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:02 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e Nov 03 13:05:02 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:02 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e" returned: 0 in 0.506s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:02 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e Nov 03 13:05:02 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:03 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-09713edd-dd05-4d7d-8ce2-a22643b1cb2e" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-quobyte-09713edd-dd05-4d7d-8ce2-a22643b1cb2e" released by "delete_volume" :: held 0.851s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Created reservations ['126877a2-03dc-41bf-aa03-4abbb8605466', '2709b7b1-4f7b-4769-baa2-d85b7b3cab06', '780017f5-3f05-47a8-8c7d-0a2ac8fc3b9f', 'a1cd142b-9050-49bc-b83e-3a190984f263'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:03 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:03 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:03 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Deleted volume successfully. Nov 03 13:05:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1a7e61a-4d64-408a-a5de-b79b3a669d0b tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-09713edd-dd05-4d7d-8ce2-a22643b1cb2e-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Flow 'volume_create_manager' (0156d4bc-1ad7-474d-92c3-8f9f00b6c57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4296ee-09f2-4563-8a0e-079b2f3a2d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4296ee-09f2-4563-8a0e-079b2f3a2d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1714374182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe82bc41-6d06-499a-b439-27d4261c6e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382f88f39c9c48349557e11ff984997e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:04Z,use_quota=True,user_id='5e6f738e796f4a62bddfd9cfb2936113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b7a9c3-7089-4b56-afad-adfa50988c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b7a9c3-7089-4b56-afad-adfa50988c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5ebe91-e6fe-404b-b27f-6033d756c456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5ebe91-e6fe-404b-b27f-6033d756c456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe82bc41-6d06-499a-b439-27d4261c6e39', 'volume_name': 'volume-fe82bc41-6d06-499a-b439-27d4261c6e39', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4aab21b-8c28-48de-9f06-b379802b37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4aab21b-8c28-48de-9f06-b379802b37e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba230fa-5fd0-41e1-8e85-f84d40db0798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Volume fe82bc41-6d06-499a-b439-27d4261c6e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe82bc41-6d06-499a-b439-27d4261c6e39', 'volume_size': 1} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1714374182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe82bc41-6d06-499a-b439-27d4261c6e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382f88f39c9c48349557e11ff984997e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:04Z,use_quota=True,user_id='5e6f738e796f4a62bddfd9cfb2936113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Creating volume fe82bc41-6d06-499a-b439-27d4261c6e39 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:04 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 1073741824 Nov 03 13:05:04 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:04 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 1073741824" returned: 0 in 0.468s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:04 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 Nov 03 13:05:04 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:04 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba230fa-5fd0-41e1-8e85-f84d40db0798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe82bc41-6d06-499a-b439-27d4261c6e39', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b58c4d-5157-404f-8e8b-fe362e09e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Volume volume-fe82bc41-6d06-499a-b439-27d4261c6e39 (fe82bc41-6d06-499a-b439-27d4261c6e39): created successfully Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b58c4d-5157-404f-8e8b-fe362e09e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Flow 'volume_create_manager' (0156d4bc-1ad7-474d-92c3-8f9f00b6c57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c342550e-2073-45fa-9e2c-19f45bd28528 tempest-VolumesTransfersV355Test-1687926174 None] Created volume successfully. Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Acquiring lock "cinder-fe82bc41-6d06-499a-b439-27d4261c6e39-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-fe82bc41-6d06-499a-b439-27d4261c6e39-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Acquiring lock "cinder-quobyte-fe82bc41-6d06-499a-b439-27d4261c6e39" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-quobyte-fe82bc41-6d06-499a-b439-27d4261c6e39" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6dc210-4e96-45ae-a7d6-cb83b8c8e458]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Flow 'volume_create_manager' (a13909f8-ad58-4c3e-99e5-cc8420c1e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb93f33-75ec-48fa-82bb-b8b82eac9d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb93f33-75ec-48fa-82bb-b8b82eac9d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-491096294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f756c7-2121-417b-887e-05d5e316e907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b6505f3f954ef59d43db9bfda6acbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:06Z,use_quota=True,user_id='98c910730801408789f2a2f390f88a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa4acea-a555-41ae-9e6c-4eb7c55a3514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa4acea-a555-41ae-9e6c-4eb7c55a3514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4272cef5-18ad-4eaa-8dd6-9862fdbf528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4272cef5-18ad-4eaa-8dd6-9862fdbf528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f756c7-2121-417b-887e-05d5e316e907', 'volume_name': 'volume-29f756c7-2121-417b-887e-05d5e316e907', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e799335f-62fc-44f1-a514-9ed54c606bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e799335f-62fc-44f1-a514-9ed54c606bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1061bbde-e0f7-4587-a16d-dc70a07bc342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Volume 29f756c7-2121-417b-887e-05d5e316e907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f756c7-2121-417b-887e-05d5e316e907', 'volume_size': 1} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-491096294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f756c7-2121-417b-887e-05d5e316e907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09b6505f3f954ef59d43db9bfda6acbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:06Z,use_quota=True,user_id='98c910730801408789f2a2f390f88a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Creating volume 29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:06 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 Nov 03 13:05:06 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:06 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:06 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 1073741824 Nov 03 13:05:06 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:06 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:07 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39 Nov 03 13:05:07 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:07 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 1073741824" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:07 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 Nov 03 13:05:07 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:07 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fe82bc41-6d06-499a-b439-27d4261c6e39" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-quobyte-fe82bc41-6d06-499a-b439-27d4261c6e39" released by "delete_volume" :: held 0.777s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Created reservations ['14bc0f33-1c3c-4872-bec0-a782b5939cba', '797fcc03-fc9f-42ca-bd0c-0a863a46034f', 'be1e783a-696a-4146-acbe-e8e824034016', 'e9447ab8-9d7f-4821-925d-0eaecc3ff89f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:07 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907" returned: 0 in 0.315s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:07 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:07 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1061bbde-e0f7-4587-a16d-dc70a07bc342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f756c7-2121-417b-887e-05d5e316e907', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7830f2cb-5c45-4439-9be7-639ef9ee6fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Volume volume-29f756c7-2121-417b-887e-05d5e316e907 (29f756c7-2121-417b-887e-05d5e316e907): created successfully Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7830f2cb-5c45-4439-9be7-639ef9ee6fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Flow 'volume_create_manager' (a13909f8-ad58-4c3e-99e5-cc8420c1e01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-6565fddb-899f-4dc5-ae6d-c43a92d38ef4 req-2b680934-11c0-49e2-a81e-b6e76d89898b tempest-VolumesSnapshotsTestJSON-314963696 None] Created volume successfully. Nov 03 13:05:07 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Deleted volume successfully. Nov 03 13:05:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf33ea60-94ba-49be-8ca2-bf58eb855dfc tempest-VolumesTransfersV355Test-1330845049 None] Lock "cinder-fe82bc41-6d06-499a-b439-27d4261c6e39-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Creating offline snapshot a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c of volume 29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:05:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1713b08-fbe3-46aa-8fb7-d29d2e539ad8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:09 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 Nov 03 13:05:09 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:09 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907" returned: 0 in 0.473s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:09 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c 1G Nov 03 13:05:09 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:09 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c 1G" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f756c7-2121-417b-887e-05d5e316e907 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:09 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f756c7-2121-417b-887e-05d5e316e907 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c Nov 03 13:05:09 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:10 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f756c7-2121-417b-887e-05d5e316e907 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:10 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c is being set with open permissions: ugo+rw Nov 03 13:05:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:10 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c Nov 03 13:05:10 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:10 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:10 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.info Nov 03 13:05:10 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:10 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.info" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:10 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.info is being set with open permissions: ugo+rw Nov 03 13:05:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:10 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.info Nov 03 13:05:10 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:11 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.info" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-57eb5d28-9661-4e64-b647-407872ef7335 req-5cb064c2-b528-4882-a497-b6b824044487 tempest-VolumesSnapshotsTestJSON-314963696 None] Create snapshot completed successfully Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "cinder-a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "cinder-quobyte-29f756c7-2121-417b-887e-05d5e316e907" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-quobyte-29f756c7-2121-417b-887e-05d5e316e907" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "cinder-quobyte-a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-quobyte-a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Deleting offline snapshot a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c of volume 29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] snapshot_file for this snap is: volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3568df27-b9cc-41ef-986a-6121354a2a3a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:11 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c Nov 03 13:05:11 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:12 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f756c7-2121-417b-887e-05d5e316e907(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:05:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[89658e77-83f5-467c-a7a4-be09700ce305]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:12 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 Nov 03 13:05:12 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:12 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:12 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c Nov 03 13:05:12 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:13 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:13 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c Nov 03 13:05:13 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:13 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907.a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-quobyte-a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c" released by "_delete_snapshot" :: held 1.645s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-quobyte-29f756c7-2121-417b-887e-05d5e316e907" released by "delete_snapshot" :: held 1.684s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG cinder.quota [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Created reservations ['42bd5aa0-6c10-4eba-85b6-57e9bb70dc8b', '5327b190-7e88-4788-8ba1-398e5e16acf0', '2b03f18b-a18c-4ef8-a026-ce03b6502ba5', '52bbc058-9257-405c-a9d6-bacad44574a5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Delete snapshot completed successfully. Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3c00759c-8b2e-468a-bad9-a79651a181ee req-347ca3ef-1b32-4dbb-8690-a8f5d2320449 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-a4b7ebcc-f6b6-4b6e-9ca7-b3e38b0ee19c-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "cinder-29f756c7-2121-417b-887e-05d5e316e907-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-29f756c7-2121-417b-887e-05d5e316e907-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "cinder-quobyte-29f756c7-2121-417b-887e-05d5e316e907" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-quobyte-29f756c7-2121-417b-887e-05d5e316e907" acquired by "delete_volume" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5143ebc0-759f-4f91-866e-514452dfa57f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:14 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 Nov 03 13:05:14 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:14 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:14 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907 Nov 03 13:05:14 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:14 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-29f756c7-2121-417b-887e-05d5e316e907" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-quobyte-29f756c7-2121-417b-887e-05d5e316e907" released by "delete_volume" :: held 0.734s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG cinder.quota [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Created reservations ['1647148e-83bb-4f06-9442-e39e21763a58', '63257cbd-3693-4fa7-ac77-270449e96bd4', 'ca662923-e82e-4b99-afad-31014e48ac9f', '39f446be-0ad2-438b-a736-5fdddda20164'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:14 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:14 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:15 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:15 devstack cinder-volume[86369]: DEBUG cinder.manager [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Deleted volume successfully. Nov 03 13:05:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-83d024ce-f52b-40a5-9b2e-d0a304e762e2 req-693339d5-8658-4eb6-be55-e4efcbd792e2 tempest-VolumesSnapshotsTestJSON-314963696 None] Lock "cinder-29f756c7-2121-417b-887e-05d5e316e907-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Flow 'volume_create_manager' (9fa5ea1c-6ebf-4973-95d8-dd99b3ca2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6147a47f-f814-4766-a517-b57ba91bed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6147a47f-f814-4766-a517-b57ba91bed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1938059741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23576a80-d161-43cf-aeb0-59dfac985ba6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4933503026574a81846a7f2206fb5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:19Z,use_quota=True,user_id='ab5e0ded2a894cb09a9f773e6792f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586cafc5-e076-480d-bc3a-a87967b0fb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586cafc5-e076-480d-bc3a-a87967b0fb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea620760-febc-47a0-a183-217c85ae0717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea620760-febc-47a0-a183-217c85ae0717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23576a80-d161-43cf-aeb0-59dfac985ba6', 'volume_name': 'volume-23576a80-d161-43cf-aeb0-59dfac985ba6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2199c9e9-9a69-4b0a-a220-fe972288329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2199c9e9-9a69-4b0a-a220-fe972288329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6a5717-3411-4775-bd42-d5e7e18bc30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Volume 23576a80-d161-43cf-aeb0-59dfac985ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23576a80-d161-43cf-aeb0-59dfac985ba6', 'volume_size': 1} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1938059741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23576a80-d161-43cf-aeb0-59dfac985ba6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4933503026574a81846a7f2206fb5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:19Z,use_quota=True,user_id='ab5e0ded2a894cb09a9f773e6792f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Creating volume 23576a80-d161-43cf-aeb0-59dfac985ba6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:19 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 1073741824 Nov 03 13:05:19 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:19 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 1073741824" returned: 0 in 0.607s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:20 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 Nov 03 13:05:20 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:20 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6a5717-3411-4775-bd42-d5e7e18bc30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23576a80-d161-43cf-aeb0-59dfac985ba6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e286cd-702c-4cd0-b8bd-e1cc83d06d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Volume volume-23576a80-d161-43cf-aeb0-59dfac985ba6 (23576a80-d161-43cf-aeb0-59dfac985ba6): created successfully Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e286cd-702c-4cd0-b8bd-e1cc83d06d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Flow 'volume_create_manager' (9fa5ea1c-6ebf-4973-95d8-dd99b3ca2af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-00524352-3f09-4e57-9dce-f96f4e6727ee tempest-VolumesTestJSON-2043510594 None] Created volume successfully. Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Flow 'volume_create_manager' (f246a529-eb91-42a5-8ce2-1a55e293a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e6e756-4d73-4fb6-875f-798bdc173668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e6e756-4d73-4fb6-875f-798bdc173668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-161072978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5558fc22-7561-4eab-ba86-47b46d63cc1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4933503026574a81846a7f2206fb5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:22Z,use_quota=True,user_id='ab5e0ded2a894cb09a9f773e6792f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98575ed9-e0c4-4d55-8f5a-45a38e6e7c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98575ed9-e0c4-4d55-8f5a-45a38e6e7c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517e2f12-4563-40ad-bb7a-b49ae9da9b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517e2f12-4563-40ad-bb7a-b49ae9da9b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5558fc22-7561-4eab-ba86-47b46d63cc1c', 'volume_name': 'volume-5558fc22-7561-4eab-ba86-47b46d63cc1c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387f1afb-3163-47b9-8f6f-55a826337793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387f1afb-3163-47b9-8f6f-55a826337793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a80bd17-cd8b-4849-af57-2e15dabf334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Volume 5558fc22-7561-4eab-ba86-47b46d63cc1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5558fc22-7561-4eab-ba86-47b46d63cc1c', 'volume_size': 1} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-161072978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5558fc22-7561-4eab-ba86-47b46d63cc1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4933503026574a81846a7f2206fb5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:22Z,use_quota=True,user_id='ab5e0ded2a894cb09a9f773e6792f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Creating volume 5558fc22-7561-4eab-ba86-47b46d63cc1c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:22 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c 1073741824 Nov 03 13:05:22 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:22 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c 1073741824" returned: 0 in 0.538s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:22 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c Nov 03 13:05:22 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:23 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a80bd17-cd8b-4849-af57-2e15dabf334e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5558fc22-7561-4eab-ba86-47b46d63cc1c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa88814b-ecaf-408d-8085-c2d4e94e3a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Volume volume-5558fc22-7561-4eab-ba86-47b46d63cc1c (5558fc22-7561-4eab-ba86-47b46d63cc1c): created successfully Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa88814b-ecaf-408d-8085-c2d4e94e3a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Flow 'volume_create_manager' (f246a529-eb91-42a5-8ce2-1a55e293a324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2c3fedf1-0bab-4d0d-b764-398178a9a821 tempest-VolumesTestJSON-2043510594 None] Created volume successfully. Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (347c4400-250a-4780-a893-d6f3c7bdd23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483783ac-cc34-40aa-85b0-b4cf17fb1c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483783ac-cc34-40aa-85b0-b4cf17fb1c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-427686717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:24Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321835fa-241b-4412-96f2-9124008f6000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321835fa-241b-4412-96f2-9124008f6000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cd4b71-3404-4064-8a59-8bf954940dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cd4b71-3404-4064-8a59-8bf954940dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee', 'volume_name': 'volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3bd94c-d6b2-40db-b7f4-7c4e352e18e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3bd94c-d6b2-40db-b7f4-7c4e352e18e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78efa7ad-ff59-4b06-8222-769829f47789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Volume 2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee', 'volume_size': 1} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-427686717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:24Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Creating volume 2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:24 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:24 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee 1073741824 Nov 03 13:05:24 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:24 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee 1073741824" returned: 0 in 0.815s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:25 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee Nov 03 13:05:25 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Flow 'volume_create_manager' (a99bcbc9-5a36-4814-bcd5-66603537240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867575ef-1890-409f-91ec-9b1317136c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867575ef-1890-409f-91ec-9b1317136c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-596641137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c89d68-b0c8-4429-a952-be8411413a23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4933503026574a81846a7f2206fb5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:25Z,use_quota=True,user_id='ab5e0ded2a894cb09a9f773e6792f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc859da-07b7-43ab-bd9f-2f22b39cce51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc859da-07b7-43ab-bd9f-2f22b39cce51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef877e0-b39e-4efe-8b34-8e6ff2618f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef877e0-b39e-4efe-8b34-8e6ff2618f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c89d68-b0c8-4429-a952-be8411413a23', 'volume_name': 'volume-89c89d68-b0c8-4429-a952-be8411413a23', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c539849-c12b-43be-a68b-de79ab146953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c539849-c12b-43be-a68b-de79ab146953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561724b5-2aab-4f36-83e6-d0745a7d116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Volume 89c89d68-b0c8-4429-a952-be8411413a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c89d68-b0c8-4429-a952-be8411413a23', 'volume_size': 1} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:25 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-596641137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c89d68-b0c8-4429-a952-be8411413a23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4933503026574a81846a7f2206fb5cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:25Z,use_quota=True,user_id='ab5e0ded2a894cb09a9f773e6792f278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Creating volume 89c89d68-b0c8-4429-a952-be8411413a23 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:25 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78efa7ad-ff59-4b06-8222-769829f47789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:25 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 1073741824 Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa970810-c99f-43c1-a8c4-e2647af72ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:25 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Volume volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee (2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee): created successfully Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa970810-c99f-43c1-a8c4-e2647af72ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (347c4400-250a-4780-a893-d6f3c7bdd23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b9d70324-199f-4fa5-8580-1d222c9bb589 tempest-VolumesSnapshotTestJSON-431029388 None] Created volume successfully. Nov 03 13:05:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-617a6e6a-c771-4556-94d1-9cddd1b133fa tempest-TestShelveInstance-763283389 None] Terminate volume connection completed successfully. Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-617a6e6a-c771-4556-94d1-9cddd1b133fa tempest-TestShelveInstance-763283389 None] Deleting attachment bcf15cbf-8513-4f48-bf1a-b0f6b92339e4. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Acquiring lock "cinder-6ca90e4d-185d-4f24-bf68-956f2335c049-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Lock "cinder-6ca90e4d-185d-4f24-bf68-956f2335c049-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:25 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 1073741824" returned: 0 in 0.570s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Acquiring lock "cinder-quobyte-6ca90e4d-185d-4f24-bf68-956f2335c049" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Lock "cinder-quobyte-6ca90e4d-185d-4f24-bf68-956f2335c049" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0c88c0-cfeb-495d-ad74-3128f91b00ad]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:26 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 Nov 03 13:05:26 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:26 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 Nov 03 13:05:26 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:26 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561724b5-2aab-4f36-83e6-d0745a7d116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c89d68-b0c8-4429-a952-be8411413a23', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c45a10-a79e-439f-a19f-f5355f217fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Volume volume-89c89d68-b0c8-4429-a952-be8411413a23 (89c89d68-b0c8-4429-a952-be8411413a23): created successfully Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c45a10-a79e-439f-a19f-f5355f217fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Flow 'volume_create_manager' (a99bcbc9-5a36-4814-bcd5-66603537240f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:26 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b12ba307-cfa9-4aed-af13-c93ea0053010 tempest-VolumesTestJSON-2043510594 None] Created volume successfully. Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049" returned: 0 in 0.481s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:26 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049 Nov 03 13:05:26 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Creating offline snapshot 0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 of volume 2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f31a0-87f7-4383-a713-e342390f6bbe]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:26 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee Nov 03 13:05:26 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:26 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6ca90e4d-185d-4f24-bf68-956f2335c049" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Lock "cinder-quobyte-6ca90e4d-185d-4f24-bf68-956f2335c049" released by "delete_volume" :: held 0.829s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.quota [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Created reservations ['40776d7c-a2ba-46d3-8d6c-cfd38da0d59d', '6ee12268-e05b-4c6f-b05b-a49dacd32fae', 'c9f44992-10a4-4139-83f3-9922f4f4e55d', '5f38116d-75fe-4fe7-a576-6326ca9e54de'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:26 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:26 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:26 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:26 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 1G Nov 03 13:05:26 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:27 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:27 devstack cinder-volume[86369]: DEBUG cinder.manager [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Deleted volume successfully. Nov 03 13:05:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-da6a91d8-b9cb-454d-aa1d-e6c6c82f1c97 req-4d6dfb52-0c69-446c-8945-09e6c937957d tempest-TestShelveInstance-763283389 None] Lock "cinder-6ca90e4d-185d-4f24-bf68-956f2335c049-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:27 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 1G" returned: 0 in 0.522s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:27 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 Nov 03 13:05:27 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:27 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:27 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 is being set with open permissions: ugo+rw Nov 03 13:05:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:27 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 Nov 03 13:05:27 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:28 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:28 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.info Nov 03 13:05:28 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Acquiring lock "cinder-89c89d68-b0c8-4429-a952-be8411413a23-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Lock "cinder-89c89d68-b0c8-4429-a952-be8411413a23-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Acquiring lock "cinder-quobyte-89c89d68-b0c8-4429-a952-be8411413a23" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Lock "cinder-quobyte-89c89d68-b0c8-4429-a952-be8411413a23" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:28 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.info" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:28 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.info is being set with open permissions: ugo+rw Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb94c8c-e266-4c30-97d1-e8601ebeeb72]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:28 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.info Nov 03 13:05:28 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:28 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 Nov 03 13:05:28 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:28 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.info" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-94364406-8f3c-4c1a-a398-92e7574c0b2d tempest-VolumesSnapshotTestJSON-431029388 None] Create snapshot completed successfully Nov 03 13:05:28 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23" returned: 0 in 0.430s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:28 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23 Nov 03 13:05:28 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:29 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-89c89d68-b0c8-4429-a952-be8411413a23" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Lock "cinder-quobyte-89c89d68-b0c8-4429-a952-be8411413a23" released by "delete_volume" :: held 0.739s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Created reservations ['0d338ae8-6281-4e09-8b66-f29449177d05', 'cbaf0be3-d891-4c6e-9eaf-d57f6a0da72f', 'f1241048-9414-42fa-8956-d54a005ff81d', '9ca810a1-d553-4b74-a25e-e0808cf51d3b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:29 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:29 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Acquiring lock "cinder-5558fc22-7561-4eab-ba86-47b46d63cc1c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:29 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Deleted volume successfully. Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Lock "cinder-5558fc22-7561-4eab-ba86-47b46d63cc1c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-742eb0b2-2e9c-4d6f-80fd-f603dedcabcb tempest-VolumesTestJSON-2043510594 None] Lock "cinder-89c89d68-b0c8-4429-a952-be8411413a23-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Acquiring lock "cinder-quobyte-5558fc22-7561-4eab-ba86-47b46d63cc1c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Lock "cinder-quobyte-5558fc22-7561-4eab-ba86-47b46d63cc1c" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fb4246-5a27-472d-ba31-5b666d1ebaee]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-0c2e5053-8e2d-48ea-9dcb-2b8087fecb03-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-0c2e5053-8e2d-48ea-9dcb-2b8087fecb03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:29 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c Nov 03 13:05:29 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Deleting offline snapshot 0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 of volume 2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:05:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] snapshot_file for this snap is: volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[02441e30-719f-4538-9243-7ae77b4947fa]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:30 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 Nov 03 13:05:30 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:30 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c" returned: 0 in 0.437s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:30 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c Nov 03 13:05:30 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:30 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" returned: 0 in 0.387s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad0dfa-30e4-4773-9ffd-db95323115a1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:30 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5558fc22-7561-4eab-ba86-47b46d63cc1c" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Lock "cinder-quobyte-5558fc22-7561-4eab-ba86-47b46d63cc1c" released by "delete_volume" :: held 0.757s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:30 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee Nov 03 13:05:30 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Created reservations ['832cd6f7-1e36-4522-802a-42e39c27a239', '6dff6a4e-4403-4b54-bd35-9c7466de1502', 'ca70929a-6a6e-4ae0-85e8-6f4ee582b054', '3d8a7afa-2066-4910-a555-a378c499f76b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:30 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:30 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Acquiring lock "cinder-23576a80-d161-43cf-aeb0-59dfac985ba6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:30 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Lock "cinder-23576a80-d161-43cf-aeb0-59dfac985ba6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:30 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 Nov 03 13:05:30 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Acquiring lock "cinder-quobyte-23576a80-d161-43cf-aeb0-59dfac985ba6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Lock "cinder-quobyte-23576a80-d161-43cf-aeb0-59dfac985ba6" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[807a31e2-fd5a-4ca8-81a6-659e0382f4a0]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:31 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.494s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Deleted volume successfully. Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92ab7325-c377-4b1f-b07d-bb311fe4fcc7 tempest-VolumesTestJSON-2043510594 None] Lock "cinder-5558fc22-7561-4eab-ba86-47b46d63cc1c-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:31 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 Nov 03 13:05:31 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:31 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" returned: 0 in 0.489s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:31 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03 Nov 03 13:05:31 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:31 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6" returned: 0 in 0.449s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:31 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6 Nov 03 13:05:31 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:31 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee.0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-0c2e5053-8e2d-48ea-9dcb-2b8087fecb03" released by "_delete_snapshot" :: held 1.726s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" released by "delete_snapshot" :: held 1.752s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['24c2ddcc-cae0-4311-95b9-f16ef67a9578', '82eed7a9-2043-4f02-8e87-4ac720a0a595', '807dc2e3-05fb-4734-8f46-9272a7e670ff', 'c677b29b-3703-4f4f-a498-fe423d8ad5e7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:31 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-23576a80-d161-43cf-aeb0-59dfac985ba6" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Lock "cinder-quobyte-23576a80-d161-43cf-aeb0-59dfac985ba6" released by "delete_volume" :: held 0.829s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Delete snapshot completed successfully. Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3377c975-476b-40b6-91b5-044b4e68ef06 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-0c2e5053-8e2d-48ea-9dcb-2b8087fecb03-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Created reservations ['f937cf35-da6a-4f17-9e15-8d2dccb8a51a', '1e740a21-c82e-4cc7-ab60-3cf0e22800c7', 'fb805263-e2bf-4652-be25-f5c71af9c7ba', '3f096943-bb29-4298-8a31-23c00fb90bc7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:32 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:32 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:32 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.314s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Deleted volume successfully. Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-801cbaa3-e614-4110-af0f-76eb5a44553c tempest-VolumesTestJSON-2043510594 None] Lock "cinder-23576a80-d161-43cf-aeb0-59dfac985ba6-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (347abb0a-4169-4104-bdaa-a6d831650e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a78e49f-3a8c-47cf-85c1-aed1ba4364d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a78e49f-3a8c-47cf-85c1-aed1ba4364d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-530914311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52666fd-50dd-461a-9dc2-9dd7d0d3fe19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:33Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0074aa-7eb9-4534-8963-800d8521db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0074aa-7eb9-4534-8963-800d8521db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebb1a27-4c0b-440d-b406-22a4f6a41375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebb1a27-4c0b-440d-b406-22a4f6a41375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52666fd-50dd-461a-9dc2-9dd7d0d3fe19', 'volume_name': 'volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db705b02-d267-4cca-9337-8b5515da9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db705b02-d267-4cca-9337-8b5515da9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cb1865-e5fb-4354-bfa5-baf9e715c94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Volume f52666fd-50dd-461a-9dc2-9dd7d0d3fe19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19', 'volume_size': 1} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-530914311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52666fd-50dd-461a-9dc2-9dd7d0d3fe19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:33Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Creating volume f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:32 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 1073741824 Nov 03 13:05:32 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:33 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 1073741824" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:33 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 Nov 03 13:05:33 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:33 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cb1865-e5fb-4354-bfa5-baf9e715c94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2a4fc9-0e35-42b5-ba39-774a34619736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Volume volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 (f52666fd-50dd-461a-9dc2-9dd7d0d3fe19): created successfully Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2a4fc9-0e35-42b5-ba39-774a34619736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (347abb0a-4169-4104-bdaa-a6d831650e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b40ab6a4-17d6-48be-befd-2134f4db5815 tempest-VolumesSnapshotTestJSON-431029388 None] Created volume successfully. Nov 03 13:05:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Creating offline snapshot 881f9299-9062-4645-8f10-114ca9ad7ae0 of volume f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:05:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7c47a-f644-4316-b2b9-918a26addc20]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:35 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 Nov 03 13:05:35 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:35 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:35 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 1G Nov 03 13:05:35 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:36 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 1G" returned: 0 in 0.595s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:36 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 Nov 03 13:05:36 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:36 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:36 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 is being set with open permissions: ugo+rw Nov 03 13:05:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:36 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 Nov 03 13:05:36 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:36 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:36 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.info Nov 03 13:05:36 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:37 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.info" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:37 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.info is being set with open permissions: ugo+rw Nov 03 13:05:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:37 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.info Nov 03 13:05:37 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:37 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.info" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-28758ed5-2c06-47dd-9d2d-ebd44f6059fd tempest-VolumesSnapshotTestJSON-431029388 None] Create snapshot completed successfully Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (e6adf9bf-2183-4f7b-8216-e52fd189da02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6313daf7-cf96-4070-8fd1-ee8117e9cf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6313daf7-cf96-4070-8fd1-ee8117e9cf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-674987520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0978863d-3c6a-46f9-8535-e1b96a8cef7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=881f9299-9062-4645-8f10-114ca9ad7ae0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:39Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02309543-4270-4e90-b3ae-5955761c78e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02309543-4270-4e90-b3ae-5955761c78e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399a0cc-162d-4d7c-b1a4-c7c2fa3a4e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399a0cc-162d-4d7c-b1a4-c7c2fa3a4e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0978863d-3c6a-46f9-8535-e1b96a8cef7d', 'volume_name': 'volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d', 'volume_size': 2, 'snapshot_id': '881f9299-9062-4645-8f10-114ca9ad7ae0'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879d843a-2768-47b8-b63c-04316f2d43b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879d843a-2768-47b8-b63c-04316f2d43b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad554ae7-9af2-47b3-a165-e89287366676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Volume 0978863d-3c6a-46f9-8535-e1b96a8cef7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d', 'volume_size': 2, 'snapshot_id': '881f9299-9062-4645-8f10-114ca9ad7ae0'} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-881f9299-9062-4645-8f10-114ca9ad7ae0-0978863d-3c6a-46f9-8535-e1b96a8cef7d" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-881f9299-9062-4645-8f10-114ca9ad7ae0-0978863d-3c6a-46f9-8535-e1b96a8cef7d" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Creating volume 0978863d-3c6a-46f9-8535-e1b96a8cef7d from snapshot 881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-0978863d-3c6a-46f9-8535-e1b96a8cef7d" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-0978863d-3c6a-46f9-8535-e1b96a8cef7d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] snapshot: 881f9299-9062-4645-8f10-114ca9ad7ae0, volume: 0978863d-3c6a-46f9-8535-e1b96a8cef7d, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe651671-7dd8-42ee-b0c5-f988e6f62ad4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:39 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 Nov 03 13:05:39 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:39 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0" returned: 0 in 0.481s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[02471b02-e7e0-4355-a82c-4ebb7427f0f0]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:39 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 Nov 03 13:05:39 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:40 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:05:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:05:40 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:05:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:40 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d Nov 03 13:05:40 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (c3a137ac-5673-4b18-b597-f5abaad4e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfa9ea2-2c16-4953-aa15-b6c11f9f2e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfa9ea2-2c16-4953-aa15-b6c11f9f2e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687184290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa50fe41-d828-4fbc-8267-635c72aefa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:41Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953b2039-4548-4351-8c69-facbdf12358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953b2039-4548-4351-8c69-facbdf12358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655c37ec-3fff-4a08-8ce2-c7e795389c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655c37ec-3fff-4a08-8ce2-c7e795389c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa50fe41-d828-4fbc-8267-635c72aefa63', 'volume_name': 'volume-fa50fe41-d828-4fbc-8267-635c72aefa63', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5adfe4-b1ac-4c9e-ac23-9f8104e1f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5adfe4-b1ac-4c9e-ac23-9f8104e1f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f5b74c-4f0d-479c-a3a1-b794c03ab8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:41 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Volume fa50fe41-d828-4fbc-8267-635c72aefa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa50fe41-d828-4fbc-8267-635c72aefa63', 'volume_size': 1} Nov 03 13:05:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (59aa78f5-bf9d-4d89-aa16-f4ca4250ebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189ea1e-35e7-4690-8494-ba3073d9b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189ea1e-35e7-4690-8494-ba3073d9b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439196776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5f7429-626c-40e0-8a56-fc243b7c05c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:42Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ca21f6-4f9f-4b30-957e-7d70e9515efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ca21f6-4f9f-4b30-957e-7d70e9515efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01a7c48-4e72-4147-9331-9ecb640b1766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01a7c48-4e72-4147-9331-9ecb640b1766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5f7429-626c-40e0-8a56-fc243b7c05c6', 'volume_name': 'volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c9d411-2acd-4f3f-949d-e52c0006c0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c9d411-2acd-4f3f-949d-e52c0006c0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd0a831-435a-4d5f-bdb8-dc2368d42832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:42 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Volume 9b5f7429-626c-40e0-8a56-fc243b7c05c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6', 'volume_size': 1} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (93d20723-617c-4410-bd58-c8892297607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c60ef7-038a-4511-afbc-73436ca28c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c60ef7-038a-4511-afbc-73436ca28c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954981991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccabba1-c3c3-482a-a5b5-83aaa776e055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:43Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c69dac-0212-44a9-8bd8-244274a069ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c69dac-0212-44a9-8bd8-244274a069ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a6dc06-7833-46a0-8e3c-1c8bd075402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a6dc06-7833-46a0-8e3c-1c8bd075402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ccabba1-c3c3-482a-a5b5-83aaa776e055', 'volume_name': 'volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bf581c-e6b5-4dfa-a0be-e09ebf1ee9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bf581c-e6b5-4dfa-a0be-e09ebf1ee9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f98e76d-1a4c-4522-aef2-9b7056e293c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Volume 8ccabba1-c3c3-482a-a5b5-83aaa776e055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055', 'volume_size': 1} Nov 03 13:05:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (bddb5483-45ae-4520-a27b-bfb97b92ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91949c1-f5bc-436a-9bce-08867fba8795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91949c1-f5bc-436a-9bce-08867fba8795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828877250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb657d20-ca28-43e8-b75b-d52261e0234c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:44Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a630892f-76ee-4053-82ae-84f887f3bf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a630892f-76ee-4053-82ae-84f887f3bf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b30087-0698-4cdf-934b-02db02226911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b30087-0698-4cdf-934b-02db02226911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb657d20-ca28-43e8-b75b-d52261e0234c', 'volume_name': 'volume-bb657d20-ca28-43e8-b75b-d52261e0234c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ddeb50-2d3c-4ade-aa27-c7e13a5307c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ddeb50-2d3c-4ade-aa27-c7e13a5307c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff68312-7feb-4e51-a0c3-c386738cae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Volume bb657d20-ca28-43e8-b75b-d52261e0234c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb657d20-ca28-43e8-b75b-d52261e0234c', 'volume_size': 1} Nov 03 13:05:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (f5759430-c62c-4253-be85-d1fb7145fd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e38328-11f6-4176-ad04-b35a3b2edf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e38328-11f6-4176-ad04-b35a3b2edf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594684299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b3b59-f75d-49d6-9b00-ec02771ede06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:45Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa9b373-048d-4f69-8faa-9881152486ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa9b373-048d-4f69-8faa-9881152486ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601cbb32-5db8-4b6d-b70f-0dece85622e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601cbb32-5db8-4b6d-b70f-0dece85622e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230b3b59-f75d-49d6-9b00-ec02771ede06', 'volume_name': 'volume-230b3b59-f75d-49d6-9b00-ec02771ede06', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae039f6-4d4c-4eb9-a95a-d301d4481a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae039f6-4d4c-4eb9-a95a-d301d4481a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a8cf65-30d4-4b53-a5c4-79391e03e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:45 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Volume 230b3b59-f75d-49d6-9b00-ec02771ede06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230b3b59-f75d-49d6-9b00-ec02771ede06', 'volume_size': 1} Nov 03 13:05:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:48 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d" returned: 0 in 8.138s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19, size 1024.00 MB, duration 8.14 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:05:48 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Converted 1024.00 MB image at 125.81 MB/s Nov 03 13:05:48 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d is being set with open permissions: ugo+rw Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:48 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d Nov 03 13:05:48 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:48 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-0978863d-3c6a-46f9-8535-e1b96a8cef7d" released by "_copy_volume_from_snapshot" :: held 9.418s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=107,cinder:UPDATE=120,cinder:INSERT=36,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=131,cinder:SELECT=112,cinder:INSERT=23,cinder:DELETE=13 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-881f9299-9062-4645-8f10-114ca9ad7ae0-0978863d-3c6a-46f9-8535-e1b96a8cef7d" released by "_create_volume_from_snapshot" :: held 9.515s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.536s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.793s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687184290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa50fe41-d828-4fbc-8267-635c72aefa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:41Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Creating volume fa50fe41-d828-4fbc-8267-635c72aefa63 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:48 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:48 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 1073741824 Nov 03 13:05:48 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad554ae7-9af2-47b3-a165-e89287366676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d', 'volume_size': 2, 'snapshot_id': '881f9299-9062-4645-8f10-114ca9ad7ae0'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5413785d-ac57-493e-984c-8792a19f81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Volume volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d (0978863d-3c6a-46f9-8535-e1b96a8cef7d): created successfully Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5413785d-ac57-493e-984c-8792a19f81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (e6adf9bf-2183-4f7b-8216-e52fd189da02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Flow 'volume_create_manager' (e45458ca-c104-4d5c-802a-f2df6601a6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060698d4-c80b-4c7a-81ca-2f9297ebf139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ebcfb88a-5da1-4745-bd28-0d489594eae3 tempest-VolumesSnapshotTestJSON-431029388 None] Created volume successfully. Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060698d4-c80b-4c7a-81ca-2f9297ebf139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1955932196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b564aff-d71b-4496-8b3d-a2cc42291ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bdb16e109648b09e0aff27ce619467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:49Z,use_quota=True,user_id='1eaab12531334c328ed1c37964e17068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914ce370-a23f-45a2-bdd9-100f25d4046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914ce370-a23f-45a2-bdd9-100f25d4046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41017fb-eb3f-4a26-9d76-018c505e2202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41017fb-eb3f-4a26-9d76-018c505e2202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b564aff-d71b-4496-8b3d-a2cc42291ec6', 'volume_name': 'volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0faf34-cca9-4b65-82b4-e598b1287847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0faf34-cca9-4b65-82b4-e598b1287847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db1d583-8b6a-4806-82e7-2b17e931e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6', 'volume_size': 1} Nov 03 13:05:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:49 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-0978863d-3c6a-46f9-8535-e1b96a8cef7d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 1073741824" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-0978863d-3c6a-46f9-8535-e1b96a8cef7d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-0978863d-3c6a-46f9-8535-e1b96a8cef7d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:49 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 Nov 03 13:05:49 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-0978863d-3c6a-46f9-8535-e1b96a8cef7d" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8addc088-f65d-42ba-b667-040a7b1252a3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:49 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d Nov 03 13:05:49 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:49 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.981s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439196776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5f7429-626c-40e0-8a56-fc243b7c05c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:42Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Creating volume 9b5f7429-626c-40e0-8a56-fc243b7c05c6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:49 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f5b74c-4f0d-479c-a3a1-b794c03ab8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa50fe41-d828-4fbc-8267-635c72aefa63', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:49 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 1073741824 Nov 03 13:05:49 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3a7ea-21d5-43a1-ba34-e766e8246cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Volume volume-fa50fe41-d828-4fbc-8267-635c72aefa63 (fa50fe41-d828-4fbc-8267-635c72aefa63): created successfully Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3a7ea-21d5-43a1-ba34-e766e8246cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (c3a137ac-5673-4b18-b597-f5abaad4e93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2d669f4b-ac2e-41a2-86f6-2478eeefcb1b tempest-CreateVolumesFromImageTest-1012099989 None] Created volume successfully. Nov 03 13:05:49 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:49 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d Nov 03 13:05:49 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:49 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 1073741824" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:49 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0978863d-3c6a-46f9-8535-e1b96a8cef7d" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-0978863d-3c6a-46f9-8535-e1b96a8cef7d" released by "delete_volume" :: held 0.721s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:49 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 Nov 03 13:05:49 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['33141e53-ce65-4b03-b3f7-48856fab4d6b', '563cfab9-23a6-45dd-9fa0-eccf5968a636', '15ddd4d4-fe41-4c94-b0a8-6302e29794be', '67887f79-675f-47f1-8cb3-21ae63dd20f4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:49 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:49 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:50 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.054s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954981991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccabba1-c3c3-482a-a5b5-83aaa776e055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:43Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Creating volume 8ccabba1-c3c3-482a-a5b5-83aaa776e055 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:50 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:50 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 1073741824 Nov 03 13:05:50 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd0a831-435a-4d5f-bdb8-dc2368d42832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b547ea29-2642-4deb-86bd-3b19b65106ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Volume volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 (9b5f7429-626c-40e0-8a56-fc243b7c05c6): created successfully Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b547ea29-2642-4deb-86bd-3b19b65106ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (59aa78f5-bf9d-4d89-aa16-f4ca4250ebd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7f1b86b3-d628-470a-9d4e-7780088f0ce9 tempest-CreateVolumesFromImageTest-1012099989 None] Created volume successfully. Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-881f9299-9062-4645-8f10-114ca9ad7ae0-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-881f9299-9062-4645-8f10-114ca9ad7ae0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:50 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-881f9299-9062-4645-8f10-114ca9ad7ae0" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Deleted volume successfully. Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-881f9299-9062-4645-8f10-114ca9ad7ae0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Deleting offline snapshot 881f9299-9062-4645-8f10-114ca9ad7ae0 of volume f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] snapshot_file for this snap is: volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-613a8380-cd2f-4a8b-91c0-e4c66631c0ea tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-0978863d-3c6a-46f9-8535-e1b96a8cef7d-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc4ad9-f3d4-4771-b4ed-961b68a48599]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:50 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 Nov 03 13:05:50 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:50 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 1073741824" returned: 0 in 0.487s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:50 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 Nov 03 13:05:50 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:50 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e9d5fc-806b-4dbf-85f6-a2c59b213a8d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:50 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 Nov 03 13:05:50 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:50 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.721s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828877250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb657d20-ca28-43e8-b75b-d52261e0234c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:44Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Creating volume bb657d20-ca28-43e8-b75b-d52261e0234c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:50 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f98e76d-1a4c-4522-aef2-9b7056e293c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:50 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c 1073741824 Nov 03 13:05:50 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6d051d-57d0-4618-a877-0c8ff7470822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Volume volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 (8ccabba1-c3c3-482a-a5b5-83aaa776e055): created successfully Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6d051d-57d0-4618-a877-0c8ff7470822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (93d20723-617c-4410-bd58-c8892297607e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dbf6f1eb-f6fd-4c2a-bd9f-f39fb2eb3928 tempest-CreateVolumesFromImageTest-1012099989 None] Created volume successfully. Nov 03 13:05:51 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c 1073741824" returned: 0 in 0.423s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:51 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" returned: 0 in 0.569s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:51 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:51 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:51 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c Nov 03 13:05:51 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:51 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.471s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594684299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b3b59-f75d-49d6-9b00-ec02771ede06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29e822c4e0344c4beb36a6919206467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:45Z,use_quota=True,user_id='cfe17bd8a7b2403ab768e7812d75f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Creating volume 230b3b59-f75d-49d6-9b00-ec02771ede06 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:51 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:51 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 1073741824 Nov 03 13:05:51 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff68312-7feb-4e51-a0c3-c386738cae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb657d20-ca28-43e8-b75b-d52261e0234c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de764885-9779-4347-a6ab-0011133084e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:51 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Volume volume-bb657d20-ca28-43e8-b75b-d52261e0234c (bb657d20-ca28-43e8-b75b-d52261e0234c): created successfully Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de764885-9779-4347-a6ab-0011133084e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (bddb5483-45ae-4520-a27b-bfb97b92ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a7dc619d-16d4-40ad-ae85-27095588348d tempest-CreateVolumesFromImageTest-1012099989 None] Created volume successfully. Nov 03 13:05:51 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0 Nov 03 13:05:51 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:52 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19.881f9299-9062-4645-8f10-114ca9ad7ae0" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-881f9299-9062-4645-8f10-114ca9ad7ae0" released by "_delete_snapshot" :: held 1.755s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" released by "delete_snapshot" :: held 1.792s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:52 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 1073741824" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:52 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 Nov 03 13:05:52 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['b4677741-35a5-44df-83ce-0187da2bb9aa', 'ab6544ab-3783-4c13-9a44-490fdd2a5e6f', 'ece8841e-5696-4d44-aab8-f100a5c214d1', '0221a6fa-6a36-4549-9553-2a0cf404661c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Delete snapshot completed successfully. Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-072dde7a-16ad-4ad3-9f14-a45440f17f21 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-881f9299-9062-4645-8f10-114ca9ad7ae0-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:52 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.682s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1955932196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b564aff-d71b-4496-8b3d-a2cc42291ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bdb16e109648b09e0aff27ce619467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:49Z,use_quota=True,user_id='1eaab12531334c328ed1c37964e17068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Creating volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:52 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a8cf65-30d4-4b53-a5c4-79391e03e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230b3b59-f75d-49d6-9b00-ec02771ede06', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42442d24-235d-48d3-9147-b5458821f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:52 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 1073741824 Nov 03 13:05:52 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Volume volume-230b3b59-f75d-49d6-9b00-ec02771ede06 (230b3b59-f75d-49d6-9b00-ec02771ede06): created successfully Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42442d24-235d-48d3-9147-b5458821f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Flow 'volume_create_manager' (f5759430-c62c-4253-be85-d1fb7145fd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-71560810-0000-4cd6-8aa1-1187a4d1df31 tempest-CreateVolumesFromImageTest-1012099989 None] Created volume successfully. Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e0c47-c0fc-4596-9fd3-56d5cf02f895]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-230b3b59-f75d-49d6-9b00-ec02771ede06-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-230b3b59-f75d-49d6-9b00-ec02771ede06-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:52 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 Nov 03 13:05:52 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-quobyte-230b3b59-f75d-49d6-9b00-ec02771ede06" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-230b3b59-f75d-49d6-9b00-ec02771ede06" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea51c37-7b11-4b92-8a9b-1e083542e113]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:52 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 1073741824" returned: 0 in 0.558s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:53 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 Nov 03 13:05:53 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:53 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 Nov 03 13:05:53 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:53 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" returned: 0 in 0.452s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:53 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19 Nov 03 13:05:53 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:53 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:53 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06 Nov 03 13:05:53 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:53 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db1d583-8b6a-4806-82e7-2b17e931e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2f1ef0-599b-4535-be63-500cc1772ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Volume volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 (4b564aff-d71b-4496-8b3d-a2cc42291ec6): created successfully Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2f1ef0-599b-4535-be63-500cc1772ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Flow 'volume_create_manager' (e45458ca-c104-4d5c-802a-f2df6601a6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:53 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19" released by "delete_volume" :: held 0.800s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a0f092e6-6964-4c57-9fa1-cf8fdf1f10e4 tempest-SnapshotsActionsTest-787634778 None] Created volume successfully. Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['8de5a74e-2209-410c-ad56-943317722ec5', '8c5a870a-c8d4-4e1d-b974-08c762d39076', '2419e73e-1edf-4c5d-89e5-a2e3a0a67833', '323cc767-208b-45a0-add2-e1be63e97918'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:53 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:53 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:53 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-230b3b59-f75d-49d6-9b00-ec02771ede06" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-230b3b59-f75d-49d6-9b00-ec02771ede06" released by "delete_volume" :: held 0.717s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Created reservations ['4e62d1ce-5721-41fb-80ac-83fe1b9adda3', 'e010115f-28d2-4f3d-bbaf-cb648d03f6c4', 'fc172ea9-4645-4b0a-aee3-3711372dbf83', '7f327a92-c123-45ef-935d-292daffb6662'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:53 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:53 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:53 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Deleted volume successfully. Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8cf282ae-0c42-4168-8259-05436a9e56d4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-f52666fd-50dd-461a-9dc2-9dd7d0d3fe19-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-bb657d20-ca28-43e8-b75b-d52261e0234c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-bb657d20-ca28-43e8-b75b-d52261e0234c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-quobyte-bb657d20-ca28-43e8-b75b-d52261e0234c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:54 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.308s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Deleted volume successfully. Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-bb657d20-ca28-43e8-b75b-d52261e0234c" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb7bfb26-3e65-4df1-ae09-7e4598768c9c tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-230b3b59-f75d-49d6-9b00-ec02771ede06-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0352a26d-57d5-4199-8be8-7ccabc4388e8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:54 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c Nov 03 13:05:54 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (45c1ccc4-02be-4a70-8422-382b4a05d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16edb9e-880f-4413-9816-9d50470b38f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16edb9e-880f-4413-9816-9d50470b38f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-808241935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9369a554-9b2a-4e68-a5da-20a31189ca1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:54Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f04cd-2d36-4ce5-a32a-129d1ea99d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f04cd-2d36-4ce5-a32a-129d1ea99d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78d702a-bf66-44c7-bbee-3e7781277c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78d702a-bf66-44c7-bbee-3e7781277c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9369a554-9b2a-4e68-a5da-20a31189ca1a', 'volume_name': 'volume-9369a554-9b2a-4e68-a5da-20a31189ca1a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9008e23-2c6d-4607-9597-90bb50d79e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9008e23-2c6d-4607-9597-90bb50d79e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a6e7df-bed3-4ae6-8873-adcb7e665efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Volume 9369a554-9b2a-4e68-a5da-20a31189ca1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9369a554-9b2a-4e68-a5da-20a31189ca1a', 'volume_size': 1} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-808241935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9369a554-9b2a-4e68-a5da-20a31189ca1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:05:54Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Creating volume 9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:05:54 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:54 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a 1073741824 Nov 03 13:05:54 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:54 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:54 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c Nov 03 13:05:54 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:54 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb657d20-ca28-43e8-b75b-d52261e0234c" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-bb657d20-ca28-43e8-b75b-d52261e0234c" released by "delete_volume" :: held 0.733s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Created reservations ['6c0b512e-e773-479e-8fc8-fbf30c888078', '36d12d8c-57ee-4dee-8b01-cc26c948adb6', '61338915-2ef1-4a45-bc93-fba0a392ee95', 'dd75fe6c-b69a-493d-bb0f-7080bb2e7c2e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:54 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a 1073741824" returned: 0 in 0.457s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:54 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:54 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:54 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a Nov 03 13:05:54 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:55 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Deleted volume successfully. Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-531e391b-ec6a-4a99-9fea-716d476a0075 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-bb657d20-ca28-43e8-b75b-d52261e0234c-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:55 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.737s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a6e7df-bed3-4ae6-8873-adcb7e665efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9369a554-9b2a-4e68-a5da-20a31189ca1a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090e09e2-5114-4285-afd7-70381831cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Creating offline snapshot 21b1139a-5eb2-4523-bd60-6b09d056baa9 of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-8ccabba1-c3c3-482a-a5b5-83aaa776e055-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Volume volume-9369a554-9b2a-4e68-a5da-20a31189ca1a (9369a554-9b2a-4e68-a5da-20a31189ca1a): created successfully Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090e09e2-5114-4285-afd7-70381831cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (45c1ccc4-02be-4a70-8422-382b4a05d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74920f5-742a-48b1-af56-6ed7c10f67e1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-8ccabba1-c3c3-482a-a5b5-83aaa776e055-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ce042a89-d5e8-4f07-8c4f-0ca2d16eb880 tempest-VolumesSnapshotTestJSON-431029388 None] Created volume successfully. Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-quobyte-8ccabba1-c3c3-482a-a5b5-83aaa776e055" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-8ccabba1-c3c3-482a-a5b5-83aaa776e055" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea386be-bbe1-4549-b8bd-d9a3143f66b6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:55 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 Nov 03 13:05:55 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:55 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 Nov 03 13:05:55 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:55 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:55 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 1G Nov 03 13:05:55 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:55 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:55 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055 Nov 03 13:05:55 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:56 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8ccabba1-c3c3-482a-a5b5-83aaa776e055" returned: 0 in 0.261s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-8ccabba1-c3c3-482a-a5b5-83aaa776e055" released by "delete_volume" :: held 0.675s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Created reservations ['64a06098-14f7-44a4-b2b2-ba0987cdd146', '70da7104-9522-4ee9-bce9-37700414f2ee', '91274596-20cd-4331-8eb0-a83ec00b244b', '8f23286c-ea1c-40dd-97f1-1955a32e62b9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:56 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 1G" returned: 0 in 0.437s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:56 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:05:56 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:56 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:56 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:56 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:56 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.345s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:56 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 is being set with open permissions: ugo+rw Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-9b5f7429-626c-40e0-8a56-fc243b7c05c6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:56 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:05:56 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Deleted volume successfully. Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-9b5f7429-626c-40e0-8a56-fc243b7c05c6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db3912d3-04bc-418d-9133-eaa2a4b43584 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-8ccabba1-c3c3-482a-a5b5-83aaa776e055-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-quobyte-9b5f7429-626c-40e0-8a56-fc243b7c05c6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-9b5f7429-626c-40e0-8a56-fc243b7c05c6" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53c6d55-f780-4e06-a3a4-d7c9c14af2db]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:56 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:56 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 Nov 03 13:05:56 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:56 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.info Nov 03 13:05:56 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:57 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:57 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.info" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:57 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.info is being set with open permissions: ugo+rw Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:57 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6 Nov 03 13:05:57 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:57 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.info Nov 03 13:05:57 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:57 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9b5f7429-626c-40e0-8a56-fc243b7c05c6" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:57 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-9b5f7429-626c-40e0-8a56-fc243b7c05c6" released by "delete_volume" :: held 0.672s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.info" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.676s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Creating offline snapshot 269d7545-b3a5-419a-ae16-3d794a9d17fa of volume 9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:05:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aa684a29-0129-481a-9682-96faa2abbf48 tempest-SnapshotsActionsTest-787634778 None] Create snapshot completed successfully Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[086b41be-510d-4dd4-a909-c5c192ed39be]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Created reservations ['01b4987a-e21e-46ae-bd31-982743f96ad2', 'b0e67c1e-8761-4c2c-8cc7-bfa6b9808365', '4400ec7e-f0a6-4d7e-89f4-32213526ef5c', '15e13ff4-df5c-4080-b063-0807c73a5f53'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:57 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a Nov 03 13:05:57 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:57 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:57 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-fa50fe41-d828-4fbc-8267-635c72aefa63-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-fa50fe41-d828-4fbc-8267-635c72aefa63-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:57 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "cinder-quobyte-fa50fe41-d828-4fbc-8267-635c72aefa63" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:05:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Deleted volume successfully. Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-fa50fe41-d828-4fbc-8267-635c72aefa63" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:05:57 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a" returned: 0 in 0.487s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f96fd58-6463-4b22-9b96-f78a22d38e60 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-9b5f7429-626c-40e0-8a56-fc243b7c05c6-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e4895-52fa-4c2e-a35c-6b439d9ef15a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:57 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa 1G Nov 03 13:05:57 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 Nov 03 13:05:58 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:58 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:58 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa 1G" returned: 0 in 0.426s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9369a554-9b2a-4e68-a5da-20a31189ca1a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:58 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63 Nov 03 13:05:58 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9369a554-9b2a-4e68-a5da-20a31189ca1a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa Nov 03 13:05:58 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa50fe41-d828-4fbc-8267-635c72aefa63" returned: 0 in 0.253s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-quobyte-fa50fe41-d828-4fbc-8267-635c72aefa63" released by "delete_volume" :: held 0.713s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:58 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Created reservations ['e552e378-106b-473c-b7c8-6d4b9ff2a250', '24c4a0d1-55ae-41b5-8a60-2752d92f0235', 'b8cac052-03d3-4b8a-8af2-14b3ac1f43a4', '6053585f-1d88-4749-90de-40c2b88b4c79'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9369a554-9b2a-4e68-a5da-20a31189ca1a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:58 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa is being set with open permissions: ugo+rw Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:58 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa Nov 03 13:05:58 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:58 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:58 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:58 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:05:58 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:58 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.info Nov 03 13:05:58 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:58 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:58 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:05:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Deleted volume successfully. Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-822de734-64b3-4e8e-beda-5ad27e001ab0 tempest-CreateVolumesFromImageTest-1012099989 None] Lock "cinder-fa50fe41-d828-4fbc-8267-635c72aefa63-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:05:59 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.info" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:59 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.info is being set with open permissions: ugo+rw Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:59 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.info Nov 03 13:05:59 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:05:59 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.info" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.391s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Creating offline snapshot 106938ae-01d0-4ab5-b227-b210100c7a1c of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:05:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3baedcc4-25f1-4119-adcd-f47fd0fdafc8 tempest-VolumesSnapshotTestJSON-431029388 None] Create snapshot completed successfully Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aeb12e-f20b-4e0f-8b79-3af34c56338e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:05:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:05:59 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:05:59 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:00 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:00 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c 1G Nov 03 13:06:00 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (ab81b1b8-3b3a-4e03-a4f8-6991a984d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faccf369-6d6b-4e78-9b5e-9ec90cebfb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faccf369-6d6b-4e78-9b5e-9ec90cebfb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1422907565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d9ac22-a4e0-4733-958f-8140ec8cf9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b9fe9c0f3f4c37b0fb8a61fa2bd582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=269d7545-b3a5-419a-ae16-3d794a9d17fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:00Z,use_quota=True,user_id='6086aafeb62f465798b0d8c01b925ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3262dc4-11db-42ce-84a3-da7bd65633ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3262dc4-11db-42ce-84a3-da7bd65633ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5223508d-feca-492e-8b34-98a5a8f3261c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5223508d-feca-492e-8b34-98a5a8f3261c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c6d9ac22-a4e0-4733-958f-8140ec8cf9e2', 'volume_name': 'volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2', 'volume_size': 1, 'snapshot_id': '269d7545-b3a5-419a-ae16-3d794a9d17fa'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800a9b6f-475c-42fb-b5d3-226d6aae6953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800a9b6f-475c-42fb-b5d3-226d6aae6953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a1f80-66ae-4242-a481-95558f536822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Volume c6d9ac22-a4e0-4733-958f-8140ec8cf9e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2', 'volume_size': 1, 'snapshot_id': '269d7545-b3a5-419a-ae16-3d794a9d17fa'} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:00 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c 1G" returned: 0 in 0.585s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:00 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c Nov 03 13:06:00 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:00 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:00 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c is being set with open permissions: ugo+rw Nov 03 13:06:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:00 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c Nov 03 13:06:00 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:01 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.716s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.608s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-269d7545-b3a5-419a-ae16-3d794a9d17fa-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-269d7545-b3a5-419a-ae16-3d794a9d17fa-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" acquired by "_create_volume_from_snapshot" :: waited 0.073s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Creating volume c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 from snapshot 269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9cb41e9b-1661-4d0d-94d6-f3cb47e18a08 tempest-SnapshotsActionsTest-787634778 None] Create snapshot completed successfully Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] snapshot: 269d7545-b3a5-419a-ae16-3d794a9d17fa, volume: c6d9ac22-a4e0-4733-958f-8140ec8cf9e2, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1d821-6bb7-4a0c-aaa9-e354d96b8fcc]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:01 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa Nov 03 13:06:01 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:01 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9369a554-9b2a-4e68-a5da-20a31189ca1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac05b3-c29b-458d-a46d-e2ea0aac9679]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:01 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a Nov 03 13:06:01 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (363ac437-2972-4f0a-a9c9-f71a188ff3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed306545-2b81-4ff7-a494-d8df56e511a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed306545-2b81-4ff7-a494-d8df56e511a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-357995947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad595880-b4c2-46ef-a459-0e91a461b243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:02Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbf087e-a2d5-4cb4-b6c9-7fe42f19dcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbf087e-a2d5-4cb4-b6c9-7fe42f19dcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c47205-c6c2-47dd-afb5-ee2ab97a45f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c47205-c6c2-47dd-afb5-ee2ab97a45f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad595880-b4c2-46ef-a459-0e91a461b243', 'volume_name': 'volume-ad595880-b4c2-46ef-a459-0e91a461b243', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e907ebb-69be-4d49-b4b4-f5aeaf23a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e907ebb-69be-4d49-b4b4-f5aeaf23a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54cc746-dd4d-4b1c-8b18-9989484e379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume ad595880-b4c2-46ef-a459-0e91a461b243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad595880-b4c2-46ef-a459-0e91a461b243', 'volume_size': 1} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:02 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:02 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 Nov 03 13:06:02 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-106938ae-01d0-4ab5-b227-b210100c7a1c-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-106938ae-01d0-4ab5-b227-b210100c7a1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-106938ae-01d0-4ab5-b227-b210100c7a1c" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-106938ae-01d0-4ab5-b227-b210100c7a1c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Deleting offline snapshot 106938ae-01d0-4ab5-b227-b210100c7a1c of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] snapshot_file for this snap is: volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b267699-e71c-46d7-ade5-a464977ffa74]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:02 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c Nov 03 13:06:02 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:03 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c" returned: 0 in 0.530s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef39c8-9137-4715-a310-4d74c8ec6ca1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:03 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:03 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:03 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.529s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:03 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c Nov 03 13:06:03 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:04 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c" returned: 0 in 0.683s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:04 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c Nov 03 13:06:04 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:04 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.106938ae-01d0-4ab5-b227-b210100c7a1c" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-106938ae-01d0-4ab5-b227-b210100c7a1c" released by "_delete_snapshot" :: held 2.304s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" released by "delete_snapshot" :: held 2.336s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:04 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Created reservations ['ebf86880-3258-4c57-ae2a-22dc95a99942', '18dcdddf-8a05-4fe7-ad4c-9ab8c4c04163', 'b8e2e5de-448d-47f4-9c3f-1cc101bd720b', '86d5209c-5764-4d17-9a59-47cc99c73112'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Delete snapshot completed successfully. Nov 03 13:06:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d0f4517-ba05-4817-afbc-8de61cb57c94 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-106938ae-01d0-4ab5-b227-b210100c7a1c-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:08 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" returned: 0 in 6.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:06:08 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Converted 1024.00 MB image at 158.97 MB/s Nov 03 13:06:08 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 is being set with open permissions: ugo+rw Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:08 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 Nov 03 13:06:08 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:08 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" returned: 0 in 0.237s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" released by "_copy_volume_from_snapshot" :: held 7.582s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-269d7545-b3a5-419a-ae16-3d794a9d17fa-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" released by "_create_volume_from_snapshot" :: held 7.650s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.724s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.819s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-357995947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad595880-b4c2-46ef-a459-0e91a461b243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:02Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Creating volume ad595880-b4c2-46ef-a459-0e91a461b243 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:08 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:08 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 1073741824 Nov 03 13:06:08 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a1f80-66ae-4242-a481-95558f536822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2', 'volume_size': 1, 'snapshot_id': '269d7545-b3a5-419a-ae16-3d794a9d17fa'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6dba4b-9d9a-4e7f-9498-6ba9e16b90ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Volume volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 (c6d9ac22-a4e0-4733-958f-8140ec8cf9e2): created successfully Nov 03 13:06:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6dba4b-9d9a-4e7f-9498-6ba9e16b90ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Flow 'volume_create_manager' (ab81b1b8-3b3a-4e03-a4f8-6991a984d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-95da9fca-9e81-4e45-950d-dcebf16d49f3 tempest-VolumesSnapshotTestJSON-431029388 None] Created volume successfully. Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eca4b3-f293-4233-9b5e-ea014f80a388]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:09 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 1073741824" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:09 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 Nov 03 13:06:09 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:09 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 Nov 03 13:06:09 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:09 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:09 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.520s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:09 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2 Nov 03 13:06:09 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Creating offline snapshot 6d630c9a-37d5-4615-93a8-6553954a5695 of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54cc746-dd4d-4b1c-8b18-9989484e379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad595880-b4c2-46ef-a459-0e91a461b243', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f877cf0c-e4dc-4491-ae4a-1dd142732cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a8165d-eb42-43b0-afa3-03f4633b6178]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume volume-ad595880-b4c2-46ef-a459-0e91a461b243 (ad595880-b4c2-46ef-a459-0e91a461b243): created successfully Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f877cf0c-e4dc-4491-ae4a-1dd142732cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (363ac437-2972-4f0a-a9c9-f71a188ff3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2940f465-176e-4b0a-9ba4-f94da991da6d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created volume successfully. Nov 03 13:06:09 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:09 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:09 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2" released by "delete_volume" :: held 0.659s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['c8e01654-f707-461a-9cff-da372176a136', '9bd3a1b9-b67a-4390-9553-b888eb9cac47', 'ea33ba53-7cb4-4051-8c50-aacbdc9d2033', '7a672fc0-d593-43a5-abbb-6470959b84e3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:10 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:10 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:10 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:10 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 1G Nov 03 13:06:10 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:10 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Deleted volume successfully. Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cc8d169-cdcc-407a-910a-29ea972fcc3e tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-c6d9ac22-a4e0-4733-958f-8140ec8cf9e2-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-269d7545-b3a5-419a-ae16-3d794a9d17fa-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-269d7545-b3a5-419a-ae16-3d794a9d17fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-9369a554-9b2a-4e68-a5da-20a31189ca1a" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-9369a554-9b2a-4e68-a5da-20a31189ca1a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-269d7545-b3a5-419a-ae16-3d794a9d17fa" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-269d7545-b3a5-419a-ae16-3d794a9d17fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Deleting offline snapshot 269d7545-b3a5-419a-ae16-3d794a9d17fa of volume 9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] snapshot_file for this snap is: volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[541d8796-ac7a-4723-96dd-00efc868e016]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:10 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa Nov 03 13:06:10 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:10 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 1G" returned: 0 in 0.517s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:10 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 Nov 03 13:06:10 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:10 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa" returned: 0 in 0.379s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9369a554-9b2a-4e68-a5da-20a31189ca1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a09ac32-b398-439a-91ad-cae6e23788a2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:11 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:11 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 is being set with open permissions: ugo+rw Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:11 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 Nov 03 13:06:11 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:11 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a Nov 03 13:06:11 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (266833ec-b0f3-49ff-9d5a-320b780183ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8893f4-ace7-49b4-a0e9-364dbec9491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8893f4-ace7-49b4-a0e9-364dbec9491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891950846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52384f2b-faa0-4c72-91a9-3be39d26c13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:11Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7ecdff-9001-4d42-a3e4-5b18e6d96b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7ecdff-9001-4d42-a3e4-5b18e6d96b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760145d2-5f7d-493d-8fcd-e2df6a99ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760145d2-5f7d-493d-8fcd-e2df6a99ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52384f2b-faa0-4c72-91a9-3be39d26c13d', 'volume_name': 'volume-52384f2b-faa0-4c72-91a9-3be39d26c13d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81af23f4-34a5-489f-932b-f61829570ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81af23f4-34a5-489f-932b-f61829570ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490710ec-8609-4124-ad3b-e044937c6b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume 52384f2b-faa0-4c72-91a9-3be39d26c13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52384f2b-faa0-4c72-91a9-3be39d26c13d', 'volume_size': 1} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:11 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.680s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891950846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52384f2b-faa0-4c72-91a9-3be39d26c13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:11Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Creating volume 52384f2b-faa0-4c72-91a9-3be39d26c13d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:11 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:11 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d 1073741824 Nov 03 13:06:11 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c7632e13-12eb-491c-9869-cfe14136e54e tempest-SnapshotsActionsTest-787634778 None] Create snapshot completed successfully Nov 03 13:06:11 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a" returned: 0 in 0.634s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:11 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa Nov 03 13:06:11 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (db1e57d1-22b8-40dc-ab35-de02be3601c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b9f41b-f96d-47fb-9ab0-8068ef105297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b9f41b-f96d-47fb-9ab0-8068ef105297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598054330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:12Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c38bc49-e67d-4745-a772-d7ff277e3d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c38bc49-e67d-4745-a772-d7ff277e3d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afabb7af-1009-4d53-baac-82b6b31ccf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afabb7af-1009-4d53-baac-82b6b31ccf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e', 'volume_name': 'volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b46c63-0ced-4fb3-b661-521cbaa00ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b46c63-0ced-4fb3-b661-521cbaa00ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96708a3-4494-4b5a-b133-b2807a2ef4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume 0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e', 'volume_size': 1} Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:11 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d 1073741824" returned: 0 in 0.552s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:12 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d Nov 03 13:06:12 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:12 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa" returned: 0 in 0.491s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:12 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa Nov 03 13:06:12 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (278a016d-c70d-4507-b27d-7c4a541e2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2eeaad6-a534-4b52-8a12-31cae56b434c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2eeaad6-a534-4b52-8a12-31cae56b434c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-349716491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7813e0-d714-4777-a40d-98983b148480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:12Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b758077c-e6ea-4eaa-88da-d5dd21292553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b758077c-e6ea-4eaa-88da-d5dd21292553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c54274-ab85-41c5-83a5-cfe429f4efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c54274-ab85-41c5-83a5-cfe429f4efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7813e0-d714-4777-a40d-98983b148480', 'volume_name': 'volume-fa7813e0-d714-4777-a40d-98983b148480', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d1be24-b5d1-4e12-b0cc-bfbfd36a7959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d1be24-b5d1-4e12-b0cc-bfbfd36a7959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c41e24-efad-42ae-80d4-e92c346c5637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume fa7813e0-d714-4777-a40d-98983b148480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7813e0-d714-4777-a40d-98983b148480', 'volume_size': 1} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:12 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d" returned: 0 in 0.297s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598054330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:12Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Creating volume 0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:12 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490710ec-8609-4124-ad3b-e044937c6b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52384f2b-faa0-4c72-91a9-3be39d26c13d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e 1073741824 Nov 03 13:06:12 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f3a6c5-93d8-4200-8af1-b2630fe326da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume volume-52384f2b-faa0-4c72-91a9-3be39d26c13d (52384f2b-faa0-4c72-91a9-3be39d26c13d): created successfully Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f3a6c5-93d8-4200-8af1-b2630fe326da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (266833ec-b0f3-49ff-9d5a-320b780183ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ffc26e03-a183-4fa0-b06b-0766e4e4b324 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created volume successfully. Nov 03 13:06:12 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a.269d7545-b3a5-419a-ae16-3d794a9d17fa" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (976df818-9fc7-4a7b-a435-94ae8b9bf7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a41f68c-3b63-4bf4-b915-a4edc6cd74a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a41f68c-3b63-4bf4-b915-a4edc6cd74a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2083679708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31daba39-1126-4b77-8dce-aa2b1e77269f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:12Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793c9fc0-ea78-4f3b-bb49-702805223196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793c9fc0-ea78-4f3b-bb49-702805223196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c717f3-4693-4f2e-959c-645a36dd0bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c717f3-4693-4f2e-959c-645a36dd0bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31daba39-1126-4b77-8dce-aa2b1e77269f', 'volume_name': 'volume-31daba39-1126-4b77-8dce-aa2b1e77269f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17e0a7e-0b7f-4c71-8096-4ffcbf41d919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17e0a7e-0b7f-4c71-8096-4ffcbf41d919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956c5446-bdcb-4496-becc-bf21075b5298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume 31daba39-1126-4b77-8dce-aa2b1e77269f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31daba39-1126-4b77-8dce-aa2b1e77269f', 'volume_size': 1} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-269d7545-b3a5-419a-ae16-3d794a9d17fa" released by "_delete_snapshot" :: held 2.133s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-9369a554-9b2a-4e68-a5da-20a31189ca1a" released by "delete_snapshot" :: held 2.160s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-6d630c9a-37d5-4615-93a8-6553954a5695-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-6d630c9a-37d5-4615-93a8-6553954a5695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-6d630c9a-37d5-4615-93a8-6553954a5695" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-6d630c9a-37d5-4615-93a8-6553954a5695" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Deleting offline snapshot 6d630c9a-37d5-4615-93a8-6553954a5695 of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] snapshot_file for this snap is: volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[71432220-45a4-4071-866d-b6a5b72d474e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['faa386e0-16e2-4f8f-b806-d078f96f66bd', '773b57e4-c46d-49b4-bd35-658466273f78', '7e7f9599-fc7d-4b74-9cea-dd7a428372f1', '3412f5d7-c4f3-4b71-a04d-55a5dacb1b82'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Delete snapshot completed successfully. Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-804de0d8-0f52-4087-8bf6-ce68667029a4 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-269d7545-b3a5-419a-ae16-3d794a9d17fa-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:12 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 Nov 03 13:06:12 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:12 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e 1073741824" returned: 0 in 0.669s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (a74074b5-091b-41d2-82d9-5e2f5cd609d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4543e7fe-69b5-4d77-9549-41ee1b57b165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4543e7fe-69b5-4d77-9549-41ee1b57b165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972455148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147316a0-d345-4af4-9d8a-352a2264793d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:13Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d009dc4-4e34-4cc7-9d52-3db5448d28b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d009dc4-4e34-4cc7-9d52-3db5448d28b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe14ec6-bdfe-40f4-a6c1-b9daeb1d64f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe14ec6-bdfe-40f4-a6c1-b9daeb1d64f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '147316a0-d345-4af4-9d8a-352a2264793d', 'volume_name': 'volume-147316a0-d345-4af4-9d8a-352a2264793d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6485e856-552b-4338-90ed-6906b8533557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6485e856-552b-4338-90ed-6906b8533557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029bc216-dfb7-40ee-a98f-4963e0cf7e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume 147316a0-d345-4af4-9d8a-352a2264793d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-147316a0-d345-4af4-9d8a-352a2264793d', 'volume_size': 1} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:13 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e Nov 03 13:06:13 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:13 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59fcb12-77b2-4159-a8aa-2a65b8090907]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:13 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-349716491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7813e0-d714-4777-a40d-98983b148480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:12Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Creating volume fa7813e0-d714-4777-a40d-98983b148480 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:13 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:13 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:13 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96708a3-4494-4b5a-b133-b2807a2ef4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:13 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 1073741824 Nov 03 13:06:13 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f6cb81-5121-4e5d-b833-addbe69fe829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e (0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e): created successfully Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f6cb81-5121-4e5d-b833-addbe69fe829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (db1e57d1-22b8-40dc-ab35-de02be3601c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7c89868b-cfc3-491d-96cd-23fe5bc0d38c tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created volume successfully. Nov 03 13:06:13 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:13 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 Nov 03 13:06:13 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-9369a554-9b2a-4e68-a5da-20a31189ca1a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-9369a554-9b2a-4e68-a5da-20a31189ca1a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-9369a554-9b2a-4e68-a5da-20a31189ca1a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-9369a554-9b2a-4e68-a5da-20a31189ca1a" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:13 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 1073741824" returned: 0 in 0.538s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[78431981-8c18-4491-9c28-dadda942a93f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:14 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 Nov 03 13:06:14 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:14 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a Nov 03 13:06:14 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:14 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:14 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695 Nov 03 13:06:14 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:14 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2083679708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31daba39-1126-4b77-8dce-aa2b1e77269f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:12Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Creating volume 31daba39-1126-4b77-8dce-aa2b1e77269f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c41e24-efad-42ae-80d4-e92c346c5637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7813e0-d714-4777-a40d-98983b148480', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:14 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f 1073741824 Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba44ad8f-de7b-4b0d-9644-b90835e0fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:14 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume volume-fa7813e0-d714-4777-a40d-98983b148480 (fa7813e0-d714-4777-a40d-98983b148480): created successfully Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba44ad8f-de7b-4b0d-9644-b90835e0fb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (278a016d-c70d-4507-b27d-7c4a541e2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1700391e-c4a2-476f-893b-7425d7ebd837 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created volume successfully. Nov 03 13:06:14 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a" returned: 0 in 0.452s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:14 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.6d630c9a-37d5-4615-93a8-6553954a5695" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:14 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a Nov 03 13:06:14 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-6d630c9a-37d5-4615-93a8-6553954a5695" released by "_delete_snapshot" :: held 1.667s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" released by "delete_snapshot" :: held 1.696s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Created reservations ['b82b6419-ad08-4c38-9ee6-fef950f0efa2', 'cde05f1a-0c8e-4c61-bc23-dcf26cb1ba26', '4bde9056-9d88-45aa-bbf3-045eacc53b48', '67417fff-572a-4cbb-9ec9-44d0637edffd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Delete snapshot completed successfully. Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cff4921f-e1e2-467a-b227-521a66676518 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-6d630c9a-37d5-4615-93a8-6553954a5695-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:14 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9369a554-9b2a-4e68-a5da-20a31189ca1a" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-9369a554-9b2a-4e68-a5da-20a31189ca1a" released by "delete_volume" :: held 0.811s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:14 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f 1073741824" returned: 0 in 0.473s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['7134b39e-69c4-42c3-af9b-e8b384896378', '52df0183-da0a-4ea2-99e5-8bf5657ef93f', 'd251215f-a8c5-40e8-92d8-c5566710a607', '983d0de8-361e-44c9-8f0d-9725ac768bc7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:14 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f Nov 03 13:06:14 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:14 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:14 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "cinder-quobyte-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:15 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:15 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972455148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147316a0-d345-4af4-9d8a-352a2264793d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ff2af4dda04ab4ae376d4f31e2d56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:13Z,use_quota=True,user_id='a07c502334f04330aa3cb840cc442bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Creating volume 147316a0-d345-4af4-9d8a-352a2264793d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:15 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f6f12-2fd2-4085-81a8-9b385937b2ea]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Deleted volume successfully. Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:15 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d 1073741824 Nov 03 13:06:15 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956c5446-bdcb-4496-becc-bf21075b5298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31daba39-1126-4b77-8dce-aa2b1e77269f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9d0bd5-ac1a-4a37-898d-8ce6ff5975eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume volume-31daba39-1126-4b77-8dce-aa2b1e77269f (31daba39-1126-4b77-8dce-aa2b1e77269f): created successfully Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9d0bd5-ac1a-4a37-898d-8ce6ff5975eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (976df818-9fc7-4a7b-a435-94ae8b9bf7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a638f9f6-a76c-4c2f-b5cc-dc1f9e90bafd tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-9369a554-9b2a-4e68-a5da-20a31189ca1a-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-46482734-cbda-4576-8022-528918ea6381 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created volume successfully. Nov 03 13:06:15 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee Nov 03 13:06:15 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:15 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:15 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d 1073741824" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:15 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee Nov 03 13:06:15 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:15 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d Nov 03 13:06:15 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:15 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-quobyte-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee" released by "delete_volume" :: held 0.794s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:15 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029bc216-dfb7-40ee-a98f-4963e0cf7e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-147316a0-d345-4af4-9d8a-352a2264793d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a87b29-91a6-40a0-9882-d88d9623367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Creating offline snapshot f0e1430e-141d-491a-8529-0a8180927314 of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Created reservations ['62336f59-4545-4041-b9f9-35d037e09194', '6b62130f-5d59-48b8-8188-0c4d2610a2ec', 'ebf6dc46-8af2-448c-a713-a905f7133e40', '0ff3bb28-47bc-4e59-b275-54e25878a81d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Volume volume-147316a0-d345-4af4-9d8a-352a2264793d (147316a0-d345-4af4-9d8a-352a2264793d): created successfully Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a87b29-91a6-40a0-9882-d88d9623367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Flow 'volume_create_manager' (a74074b5-091b-41d2-82d9-5e2f5cd609d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4b9753-4714-4a07-8e1c-868e85f7a12a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-57e46ddd-7c70-4ed3-a50d-a49ed6d3068d tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created volume successfully. Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:16 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:16 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:16 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:16 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:16 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Deleted volume successfully. Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-147316a0-d345-4af4-9d8a-352a2264793d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-147316a0-d345-4af4-9d8a-352a2264793d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ab7a76-46ff-4c82-aebb-19136bb77bd5 tempest-VolumesSnapshotTestJSON-431029388 None] Lock "cinder-2e37f3b6-39b1-4812-8c9f-6004d4ccb5ee-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-quobyte-147316a0-d345-4af4-9d8a-352a2264793d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-147316a0-d345-4af4-9d8a-352a2264793d" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:16 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf0852e-ad51-40f2-b8aa-19b4211bfb29]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:16 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 1G Nov 03 13:06:16 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:16 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d Nov 03 13:06:16 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:16 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:16 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d Nov 03 13:06:16 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:17 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 1G" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:17 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 Nov 03 13:06:17 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:17 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-147316a0-d345-4af4-9d8a-352a2264793d" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-147316a0-d345-4af4-9d8a-352a2264793d" released by "delete_volume" :: held 0.733s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created reservations ['0e1f32a3-79b5-4a6e-b620-51815c83b90e', '0b7a0837-2ddd-46b2-becc-f1ec4b35e78a', '5ca13f58-1f36-4bb7-9848-aedc79ddd5a9', '8725db49-193b-4ddd-ba35-f45e4f18c53d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:17 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314" returned: 0 in 0.349s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:17 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 is being set with open permissions: ugo+rw Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:17 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 Nov 03 13:06:17 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:17 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:17 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-31daba39-1126-4b77-8dce-aa2b1e77269f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:17 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.715s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-31daba39-1126-4b77-8dce-aa2b1e77269f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:17 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Deleted volume successfully. Nov 03 13:06:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-095ed421-7d43-4712-9a45-8bf8fb550496 tempest-SnapshotsActionsTest-787634778 None] Create snapshot completed successfully Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-quobyte-31daba39-1126-4b77-8dce-aa2b1e77269f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-52af6062-ee6e-4626-b246-87499a724de7 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-147316a0-d345-4af4-9d8a-352a2264793d-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-31daba39-1126-4b77-8dce-aa2b1e77269f" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d109da66-c003-4da5-abdd-fe37a9857f32]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:17 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f Nov 03 13:06:17 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:18 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:18 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f Nov 03 13:06:18 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-f0e1430e-141d-491a-8529-0a8180927314-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-f0e1430e-141d-491a-8529-0a8180927314-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:18 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-31daba39-1126-4b77-8dce-aa2b1e77269f" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-31daba39-1126-4b77-8dce-aa2b1e77269f" released by "delete_volume" :: held 0.754s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-f0e1430e-141d-491a-8529-0a8180927314" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-f0e1430e-141d-491a-8529-0a8180927314" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Deleting offline snapshot f0e1430e-141d-491a-8529-0a8180927314 of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] snapshot_file for this snap is: volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[32260ff2-7dcd-4c53-84a1-f3b27280d1e0]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created reservations ['1ee4a4b3-3da6-4069-aa41-31d724cd80e2', '364f9c26-b070-4da1-b619-eb9265fab86f', '17803ad0-8ff2-4fd5-ac6b-7df9ffd0e778', 'ed75617f-c62a-47f3-bdca-1c05d4e108f8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:18 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 Nov 03 13:06:18 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:18 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:18 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-fa7813e0-d714-4777-a40d-98983b148480-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-fa7813e0-d714-4777-a40d-98983b148480-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-quobyte-fa7813e0-d714-4777-a40d-98983b148480" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-fa7813e0-d714-4777-a40d-98983b148480" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[609068e2-794d-4d1e-911e-09ab7d8496e0]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:19 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:19 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314" returned: 0 in 0.479s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Deleted volume successfully. Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[820285a3-52a7-43b7-b00e-2365a7a001da]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8930d0b1-60fe-4d80-b0b0-9c4ae4af7c78 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-31daba39-1126-4b77-8dce-aa2b1e77269f-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:19 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 Nov 03 13:06:19 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:19 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:19 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:19 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:19 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480 Nov 03 13:06:19 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:19 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:19 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 Nov 03 13:06:19 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:19 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fa7813e0-d714-4777-a40d-98983b148480" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-fa7813e0-d714-4777-a40d-98983b148480" released by "delete_volume" :: held 0.744s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created reservations ['a19529f1-094e-4803-a941-647e97adc8fd', 'c9d3e11e-c84b-4578-90c7-419435999ff8', 'f2627006-3756-415c-96cd-730cb165b7b7', '8406d371-89c9-44ee-ae90-efd1a573a835'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:19 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:19 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:19 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:20 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314 Nov 03 13:06:20 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:20 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Deleted volume successfully. Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9ea1908-4de6-405a-b9ca-267392eeedf6 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-fa7813e0-d714-4777-a40d-98983b148480-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-quobyte-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:20 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.f0e1430e-141d-491a-8529-0a8180927314" returned: 0 in 0.325s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-f0e1430e-141d-491a-8529-0a8180927314" released by "_delete_snapshot" :: held 1.808s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e" acquired by "delete_volume" :: waited 0.082s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" released by "delete_snapshot" :: held 1.859s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[88175f73-6eda-4d26-b8fd-31ec07b5c428]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Created reservations ['d36be2fb-b338-4f9e-9098-9865ede94a42', '89d42c9d-1257-4c80-b69e-969c243ccb65', '52586086-ff37-464c-b2b3-db6933d61a22', '4e07e872-6e7b-4082-a7ae-e89c78aae834'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:20 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e Nov 03 13:06:20 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Delete snapshot completed successfully. Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d873605e-3484-4fa4-b4cd-7ff35ea5debd tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-f0e1430e-141d-491a-8529-0a8180927314-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:20 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e" returned: 0 in 0.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:20 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e Nov 03 13:06:20 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Creating offline snapshot c6fb09d3-c760-4a7a-b74d-f37d3044a10b of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c460a61-c4e6-46bf-b260-f0538d29c67f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:21 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:21 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:21 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e" released by "delete_volume" :: held 0.810s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created reservations ['8a28d367-6dfc-44b0-a334-eedecddfc745', '00f1a05d-e07d-4cc1-abcd-e3a84b967022', '04747f4a-324c-4943-adc1-105a6df2f771', 'bd6eed12-9e42-4677-9e95-e79207ea2693'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:21 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:21 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-52384f2b-faa0-4c72-91a9-3be39d26c13d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-52384f2b-faa0-4c72-91a9-3be39d26c13d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-quobyte-52384f2b-faa0-4c72-91a9-3be39d26c13d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-52384f2b-faa0-4c72-91a9-3be39d26c13d" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:21 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec79aae-09aa-4cfc-9036-b84fe6487691]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.581s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:21 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Deleted volume successfully. Nov 03 13:06:21 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b 1G Nov 03 13:06:21 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bece95f2-32f6-4576-9fc4-61fbfa17d57f tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-0cf2ff72-282f-43ce-bfcc-e146a6f0aa2e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:21 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d Nov 03 13:06:21 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:22 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d" returned: 0 in 0.439s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:22 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d Nov 03 13:06:22 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:22 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b 1G" returned: 0 in 0.527s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:22 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b Nov 03 13:06:22 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:22 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52384f2b-faa0-4c72-91a9-3be39d26c13d" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-52384f2b-faa0-4c72-91a9-3be39d26c13d" released by "delete_volume" :: held 0.788s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created reservations ['d4cff87b-8489-4201-9b35-214604ee3059', '712691ba-3115-4d09-857a-7b24ae826ff0', 'e99e0472-885a-4b84-b39f-8aa57703fffb', '8f5306ef-70da-4a5b-9bc8-e17300fc8f4d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:22 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:22 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b is being set with open permissions: ugo+rw Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:22 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b Nov 03 13:06:22 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:22 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:22 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-ad595880-b4c2-46ef-a459-0e91a461b243-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-ad595880-b4c2-46ef-a459-0e91a461b243-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "cinder-quobyte-ad595880-b4c2-46ef-a459-0e91a461b243" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-ad595880-b4c2-46ef-a459-0e91a461b243" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698d8ef-b5bd-4524-831e-493e175249d5]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:22 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Deleted volume successfully. Nov 03 13:06:22 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-65259b4c-5c6f-4e49-b248-6006d537ef9e tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-52384f2b-faa0-4c72-91a9-3be39d26c13d-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:23 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 Nov 03 13:06:23 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ebfbbb1d-65e2-4e09-b513-3d397d5e9924 tempest-SnapshotsActionsTest-787634778 None] Create snapshot completed successfully Nov 03 13:06:23 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243" returned: 0 in 0.469s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:23 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243 Nov 03 13:06:23 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:23 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad595880-b4c2-46ef-a459-0e91a461b243" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-quobyte-ad595880-b4c2-46ef-a459-0e91a461b243" released by "delete_volume" :: held 0.803s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Created reservations ['8a40c1a2-1ddc-4834-83d5-6194be6123c7', '690d85e5-59f9-446a-ab70-01fdcc163ab1', '9e5b4f4a-bb7d-4b29-9cbb-bed99f142b86', '9890d6be-edb5-4894-9af4-e3058cba5e59'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:23 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:23 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:23 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Deleted volume successfully. Nov 03 13:06:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ecfc3ed-d54b-452d-b91d-d270004c7648 tempest-CreateVolumesFromSourceVolumeTest-1696434655 None] Lock "cinder-ad595880-b4c2-46ef-a459-0e91a461b243-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-c6fb09d3-c760-4a7a-b74d-f37d3044a10b-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-c6fb09d3-c760-4a7a-b74d-f37d3044a10b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Acquiring lock "cinder-quobyte-c6fb09d3-c760-4a7a-b74d-f37d3044a10b" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-c6fb09d3-c760-4a7a-b74d-f37d3044a10b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Deleting offline snapshot c6fb09d3-c760-4a7a-b74d-f37d3044a10b of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] snapshot_file for this snap is: volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dcaf28-93a5-49d7-8123-a1ab8b5e8314]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:24 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b Nov 03 13:06:24 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:24 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[766aaad3-07b2-46c5-a00e-21bc9102bac1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:25 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:25 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:25 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:25 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b Nov 03 13:06:25 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:25 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:25 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b Nov 03 13:06:25 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:26 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.c6fb09d3-c760-4a7a-b74d-f37d3044a10b" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-c6fb09d3-c760-4a7a-b74d-f37d3044a10b" released by "_delete_snapshot" :: held 1.797s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" released by "delete_snapshot" :: held 1.828s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:26 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Created reservations ['ba4d5df0-6ad9-4962-9583-9fbdd00b637a', '1990203b-171e-4100-9374-e9ddec314e47', 'ebf9e7b0-2213-46e2-bbee-44710e2337ad', '36846370-a46e-4a38-88a5-1ee4460da11a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Delete snapshot completed successfully. Nov 03 13:06:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2cf8cee7-f625-4075-ad90-145a9fc2c275 tempest-SnapshotsActionsTest-495028040 None] Lock "cinder-c6fb09d3-c760-4a7a-b74d-f37d3044a10b-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "cinder-21b1139a-5eb2-4523-bd60-6b09d056baa9-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-21b1139a-5eb2-4523-bd60-6b09d056baa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "cinder-quobyte-21b1139a-5eb2-4523-bd60-6b09d056baa9" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-quobyte-21b1139a-5eb2-4523-bd60-6b09d056baa9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Deleting offline snapshot 21b1139a-5eb2-4523-bd60-6b09d056baa9 of volume 4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] snapshot_file for this snap is: volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeff565a-b206-46af-89a2-3be37768bed7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:27 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:27 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:27 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f3ba80-ce61-429d-a25f-60577cdff2af]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:27 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 Nov 03 13:06:27 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:28 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6" returned: 0 in 0.447s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:28 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:28 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:28 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:28 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9 Nov 03 13:06:28 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:28 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6.21b1139a-5eb2-4523-bd60-6b09d056baa9" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-quobyte-21b1139a-5eb2-4523-bd60-6b09d056baa9" released by "_delete_snapshot" :: held 1.723s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" released by "delete_snapshot" :: held 1.764s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Created reservations ['6d0158e1-7a4d-4715-b592-4c1a901170fb', '7be1d613-bc9a-49f8-ba07-84451fe7689d', 'e62fcf9f-f046-4939-8757-16e71a8faa99', '0a451dd3-008a-421f-a129-ff4370ded594'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Delete snapshot completed successfully. Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dd31b875-8fe6-4958-a54f-15f14ca9f1d9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-21b1139a-5eb2-4523-bd60-6b09d056baa9-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "cinder-4b564aff-d71b-4496-8b3d-a2cc42291ec6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-4b564aff-d71b-4496-8b3d-a2cc42291ec6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bcb9da-6923-4fcf-a6b1-b6ef89b122cf]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:29 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 Nov 03 13:06:29 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Flow 'volume_create_manager' (8525dccf-93dc-4f36-9217-09f40bfdb371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f6b87f-0b23-44a1-b968-2a30fd58cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f6b87f-0b23-44a1-b968-2a30fd58cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017264f8-0fd4-4de7-b585-1e3849a78dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051b4beb3a41462481efc774ec8d1d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:30Z,use_quota=True,user_id='44b3e4187fbe48d5811b5d40210e4331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4846bc5f-50ff-4aec-be22-ba2e60b0d3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4846bc5f-50ff-4aec-be22-ba2e60b0d3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339fd4b8-54f9-4b86-b71c-d60f3a8a1448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:06:30 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6" returned: 0 in 0.628s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:30 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6 Nov 03 13:06:30 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:30 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4b564aff-d71b-4496-8b3d-a2cc42291ec6" returned: 0 in 0.353s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-quobyte-4b564aff-d71b-4496-8b3d-a2cc42291ec6" released by "delete_volume" :: held 1.071s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339fd4b8-54f9-4b86-b71c-d60f3a8a1448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '017264f8-0fd4-4de7-b585-1e3849a78dbb', 'volume_name': 'volume-017264f8-0fd4-4de7-b585-1e3849a78dbb', 'volume_size': 1, 'image_id': '88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5df67dcde097c32867d6377d31bf4519', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '051b4beb3a41462481efc774ec8d1d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5889a07a2a10b708d6e6698639e19fc2c871de337fa7721721383a7da7d50231cd813e24a0ab804d0f3d2a05c33b559ca43c6027f824e61d50f13d3988ab43a5', 'id': '88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'created_at': datetime.datetime(2026, 11, 3, 12, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79/file', 'properties': {}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a59c67b-dfe7-4562-9a19-459813ed81c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a59c67b-dfe7-4562-9a19-459813ed81c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593b17cd-137d-4668-a515-5631b578cdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Volume 017264f8-0fd4-4de7-b585-1e3849a78dbb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-017264f8-0fd4-4de7-b585-1e3849a78dbb', 'volume_size': 1, 'image_id': '88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5df67dcde097c32867d6377d31bf4519', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '051b4beb3a41462481efc774ec8d1d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5889a07a2a10b708d6e6698639e19fc2c871de337fa7721721383a7da7d50231cd813e24a0ab804d0f3d2a05c33b559ca43c6027f824e61d50f13d3988ab43a5', 'id': '88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'created_at': datetime.datetime(2026, 11, 3, 12, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79/file', 'properties': {}}, 'image_service': } Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Trying to clone 017264f8-0fd4-4de7-b585-1e3849a78dbb from image 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Created reservations ['758974e6-052b-48e0-9ad8-f79dba6eb13a', '4b4ad933-c853-4c84-b874-004afd186c93', '0d8d3fbd-4fa2-490f-aeb0-03f0620f71cc', '8c2a1817-34b9-409b-a52e-68108678c849'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:06:30 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:30 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:30 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d48cb0d-ab9e-4628-ab4b-56b9733cdfec]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:31 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD Nov 03 13:06:31 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:31 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Deleted volume successfully. Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cb0d3d4a-edec-49c6-9509-0ae3635e2fe9 tempest-SnapshotsActionsTest-787634778 None] Lock "cinder-4b564aff-d71b-4496-8b3d-a2cc42291ec6-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:31 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:31 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD Nov 03 13:06:31 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:31 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Temporary image 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 is fetched for user 44b3e4187fbe48d5811b5d40210e4331. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d39cc-c9e7-481e-ae5e-19e76116ca70]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:32 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD Nov 03 13:06:32 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:32 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:32 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD Nov 03 13:06:32 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:32 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017264f8-0fd4-4de7-b585-1e3849a78dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051b4beb3a41462481efc774ec8d1d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:30Z,use_quota=True,user_id='44b3e4187fbe48d5811b5d40210e4331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Creating volume 017264f8-0fd4-4de7-b585-1e3849a78dbb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:32 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb 1073741824 Nov 03 13:06:32 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:33 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb 1073741824" returned: 0 in 0.629s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:33 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb Nov 03 13:06:33 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:33 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Attempting download of 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 ((None, [{'url': 'file:///opt/stack/data/glance/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'metadata': {}}])) to volume 017264f8-0fd4-4de7-b585-1e3849a78dbb. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f232856-1f36-45ee-80ac-847798881231]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_kt5ywjn3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:33 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_kt5ywjn3 Nov 03 13:06:33 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:34 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_kt5ywjn3" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_kt5ywjn3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:34 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_kt5ywjn3 Nov 03 13:06:34 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:34 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_kt5ywjn3" returned: 1 in 0.374s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_kt5ywjn3' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f2b776-81db-4730-8c3d-42d082cc2edf]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:34 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD Nov 03 13:06:34 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:34 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:35 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD Nov 03 13:06:35 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:35 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:06:35 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:06:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:35 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb Nov 03 13:06:35 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:35 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb" returned: 0 in 0.558s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:35 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79_0mj3phzvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:06:35 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:06:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:35 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb 1G Nov 03 13:06:35 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:36 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb 1G" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Downloaded image 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 ((None, [{'url': 'file:///opt/stack/data/glance/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'metadata': {}}])) to volume 017264f8-0fd4-4de7-b585-1e3849a78dbb successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Temporary image 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 for user 44b3e4187fbe48d5811b5d40210e4331 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Marking volume 017264f8-0fd4-4de7-b585-1e3849a78dbb as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Copying metadata from image 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 to 017264f8-0fd4-4de7-b585-1e3849a78dbb. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Creating volume glance metadata for volume 017264f8-0fd4-4de7-b585-1e3849a78dbb backed by image 88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79 with: {'image_id': '88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5df67dcde097c32867d6377d31bf4519', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593b17cd-137d-4668-a515-5631b578cdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017264f8-0fd4-4de7-b585-1e3849a78dbb', 'volume_size': 1, 'image_id': '88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5df67dcde097c32867d6377d31bf4519', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '051b4beb3a41462481efc774ec8d1d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5889a07a2a10b708d6e6698639e19fc2c871de337fa7721721383a7da7d50231cd813e24a0ab804d0f3d2a05c33b559ca43c6027f824e61d50f13d3988ab43a5', 'id': '88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79', 'created_at': datetime.datetime(2026, 11, 3, 12, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 6, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88a8c0cc-2e2f-44b5-bd21-46c7a76f1a79/file', 'properties': {}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15233b32-351b-41c9-b9a6-52780ff9cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Volume volume-017264f8-0fd4-4de7-b585-1e3849a78dbb (017264f8-0fd4-4de7-b585-1e3849a78dbb): created successfully Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15233b32-351b-41c9-b9a6-52780ff9cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Flow 'volume_create_manager' (8525dccf-93dc-4f36-9217-09f40bfdb371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-92567911-6b89-4a11-9dc4-4f5ce69a5488 tempest-VolumeImageDependencyTests-1990936167 None] Created volume successfully. Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Acquiring lock "cinder-017264f8-0fd4-4de7-b585-1e3849a78dbb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Lock "cinder-017264f8-0fd4-4de7-b585-1e3849a78dbb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Acquiring lock "cinder-quobyte-017264f8-0fd4-4de7-b585-1e3849a78dbb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Lock "cinder-quobyte-017264f8-0fd4-4de7-b585-1e3849a78dbb" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d35069a-630b-4027-a77d-afde3ed12b08]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:37 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb Nov 03 13:06:37 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:37 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb" returned: 0 in 0.404s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:37 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb Nov 03 13:06:37 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:37 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-017264f8-0fd4-4de7-b585-1e3849a78dbb" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Lock "cinder-quobyte-017264f8-0fd4-4de7-b585-1e3849a78dbb" released by "delete_volume" :: held 0.754s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Created reservations ['33110700-b643-4a2e-91cb-3aad349d8f96', '996fc5bc-9b82-40a0-a426-0851edb1686a', 'd1af610b-0c07-4c18-99f0-6a568fd34bda', '5b82b6e3-7923-40c3-837f-cfc5c0ecc931'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:37 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:37 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:38 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Deleted volume successfully. Nov 03 13:06:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cc3809cd-ad54-483d-9003-3c774a5857fe tempest-VolumeImageDependencyTests-1990936167 None] Lock "cinder-017264f8-0fd4-4de7-b585-1e3849a78dbb-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:06:47 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=171,cinder:INSERT=60,cinder:UPDATE=249,cinder:DELETE=18 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:06:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=222,cinder:SELECT=178,cinder:DELETE=22,cinder:INSERT=67 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:06:51 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Flow 'volume_create_manager' (1863ed81-3451-44ac-9cc2-ded8739d4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22e7363-185f-4dd9-9778-3eb35b594767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22e7363-185f-4dd9-9778-3eb35b594767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-374122704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e9945-588b-4a9c-a49e-25107b1c8bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2358d7df4864b76e9cc2f89772c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:52Z,use_quota=True,user_id='545a522f52de482391392e1efd96dc2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae0fb69-0962-479c-9f14-5c05feaff5b8),volume_type_id=aae0fb69-0962-479c-9f14-5c05feaff5b8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f857756d-1e56-4763-a032-9eca78fe8e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f857756d-1e56-4763-a032-9eca78fe8e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30664770-406d-4a5f-acd7-43adb4cdcb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30664770-406d-4a5f-acd7-43adb4cdcb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79e9945-588b-4a9c-a49e-25107b1c8bcc', 'volume_name': 'volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3b2eee-7fa4-4917-a173-bc9bc9a49074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3b2eee-7fa4-4917-a173-bc9bc9a49074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cee6f9-87cf-4244-a692-9ce8b1501699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume b79e9945-588b-4a9c-a49e-25107b1c8bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc', 'volume_size': 1} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-374122704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e9945-588b-4a9c-a49e-25107b1c8bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2358d7df4864b76e9cc2f89772c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:52Z,use_quota=True,user_id='545a522f52de482391392e1efd96dc2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae0fb69-0962-479c-9f14-5c05feaff5b8),volume_type_id=aae0fb69-0962-479c-9f14-5c05feaff5b8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Creating volume b79e9945-588b-4a9c-a49e-25107b1c8bcc {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:52 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:52 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc 1073741824 Nov 03 13:06:52 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Flow 'volume_create_manager' (47cd2701-0d8f-470a-b86a-b8da5f5086c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4afa3a-168d-426e-ba66-cdf868ae39d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4afa3a-168d-426e-ba66-cdf868ae39d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1554199547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e2519c-137c-4f16-beaf-712ecf346a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2358d7df4864b76e9cc2f89772c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:52Z,use_quota=True,user_id='545a522f52de482391392e1efd96dc2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd621bce-df50-4f16-9e42-8aaa8977fb1f),volume_type_id=fd621bce-df50-4f16-9e42-8aaa8977fb1f)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f438df1-aa8b-423c-8d85-5469b149ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f438df1-aa8b-423c-8d85-5469b149ad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef838054-d181-4596-8959-8dcbb8ac8ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef838054-d181-4596-8959-8dcbb8ac8ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e2519c-137c-4f16-beaf-712ecf346a19', 'volume_name': 'volume-68e2519c-137c-4f16-beaf-712ecf346a19', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6193f3-8508-4615-b8a3-5c64f3782e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6193f3-8508-4615-b8a3-5c64f3782e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1add3c-fd97-4da2-84ec-623d66c9c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume 68e2519c-137c-4f16-beaf-712ecf346a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e2519c-137c-4f16-beaf-712ecf346a19', 'volume_size': 1} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:52 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc 1073741824" returned: 0 in 0.720s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:52 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc Nov 03 13:06:52 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:53 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1554199547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e2519c-137c-4f16-beaf-712ecf346a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2358d7df4864b76e9cc2f89772c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:52Z,use_quota=True,user_id='545a522f52de482391392e1efd96dc2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd621bce-df50-4f16-9e42-8aaa8977fb1f),volume_type_id=fd621bce-df50-4f16-9e42-8aaa8977fb1f)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Creating volume 68e2519c-137c-4f16-beaf-712ecf346a19 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:53 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:53 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 1073741824 Nov 03 13:06:53 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cee6f9-87cf-4244-a692-9ce8b1501699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071ae4c2-7d26-40d9-af00-72a5c8c6a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc (b79e9945-588b-4a9c-a49e-25107b1c8bcc): created successfully Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071ae4c2-7d26-40d9-af00-72a5c8c6a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Flow 'volume_create_manager' (1863ed81-3451-44ac-9cc2-ded8739d4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aa4455a6-8c48-402c-a9f5-cc859c524b9b tempest-TestInstancesWithCinderVolumes-1911243997 None] Created volume successfully. Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Flow 'volume_create_manager' (13c4d882-2b2e-4bd4-b23a-05c1ec56b275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1dbb5d-d7d7-4d65-aed3-531f53f71188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1dbb5d-d7d7-4d65-aed3-531f53f71188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1298794704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05779f36-e078-45a4-944b-fcb71b125242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2358d7df4864b76e9cc2f89772c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:54Z,use_quota=True,user_id='545a522f52de482391392e1efd96dc2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f914dd7-8f2d-41ea-8a9c-29ce328d9ed3),volume_type_id=0f914dd7-8f2d-41ea-8a9c-29ce328d9ed3)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b5cc88-bea7-4d8d-9503-036e214e6592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b5cc88-bea7-4d8d-9503-036e214e6592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225ad0c8-8489-4e67-800f-307cbfcb56fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:06:54 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 1073741824" returned: 0 in 0.902s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:54 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 Nov 03 13:06:54 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225ad0c8-8489-4e67-800f-307cbfcb56fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05779f36-e078-45a4-944b-fcb71b125242', 'volume_name': 'volume-05779f36-e078-45a4-944b-fcb71b125242', 'volume_size': 1, 'image_id': '9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1025947902', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e9c2358d7df4864b76e9cc2f89772c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'created_at': datetime.datetime(2026, 11, 3, 12, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99/file', 'properties': {}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a1954c-7346-48f7-9b8e-122668ebf7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a1954c-7346-48f7-9b8e-122668ebf7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a89a54-b860-4e3d-9cf0-10372902f948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume 05779f36-e078-45a4-944b-fcb71b125242: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05779f36-e078-45a4-944b-fcb71b125242', 'volume_size': 1, 'image_id': '9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1025947902', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e9c2358d7df4864b76e9cc2f89772c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'created_at': datetime.datetime(2026, 11, 3, 12, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99/file', 'properties': {}}, 'image_service': } Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Trying to clone 05779f36-e078-45a4-944b-fcb71b125242 from image 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:06:54 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1add3c-fd97-4da2-84ec-623d66c9c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e2519c-137c-4f16-beaf-712ecf346a19', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8d9ab9-f16d-4497-b539-89e237886342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:06:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume volume-68e2519c-137c-4f16-beaf-712ecf346a19 (68e2519c-137c-4f16-beaf-712ecf346a19): created successfully Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8d9ab9-f16d-4497-b539-89e237886342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:06:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Flow 'volume_create_manager' (47cd2701-0d8f-470a-b86a-b8da5f5086c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:06:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1a17ae3f-cff0-4a0f-9fc8-7c1ba15d4424 tempest-TestInstancesWithCinderVolumes-1911243997 None] Created volume successfully. Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD, size 20.69 MB, duration 3.69 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:06:58 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Image download 20.69 MB at 5.61 MB/s Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1cb94f-bf7b-40c1-90ed-92bc65e785c5]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:58 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD Nov 03 13:06:58 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:58 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:06:58 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:58 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Temporary image 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 is fetched for user 545a522f52de482391392e1efd96dc2e. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[91536f3a-b64c-4d95-8197-0d81da9b8d3c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:06:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:59 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD Nov 03 13:06:59 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:59 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:06:59 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1298794704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05779f36-e078-45a4-944b-fcb71b125242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9c2358d7df4864b76e9cc2f89772c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:06:54Z,use_quota=True,user_id='545a522f52de482391392e1efd96dc2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f914dd7-8f2d-41ea-8a9c-29ce328d9ed3),volume_type_id=0f914dd7-8f2d-41ea-8a9c-29ce328d9ed3)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Creating volume 05779f36-e078-45a4-944b-fcb71b125242 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:06:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:59 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 1073741824 Nov 03 13:06:59 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:06:59 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 1073741824" returned: 0 in 0.540s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:06:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:06:59 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 Nov 03 13:06:59 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:00 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Attempting download of 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'metadata': {}}])) to volume 05779f36-e078-45a4-944b-fcb71b125242. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b72877-b9a9-40a6-bc8e-d88e970ef636]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_ffiryec7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:00 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_ffiryec7 Nov 03 13:07:00 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:00 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_ffiryec7" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_ffiryec7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:01 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_ffiryec7 Nov 03 13:07:01 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:01 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_ffiryec7" returned: 1 in 0.506s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_ffiryec7' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:07:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9858b25d-16ba-4453-85f1-8293c3975729]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:01 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD Nov 03 13:07:01 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:01 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:01 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:07:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:01 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 Nov 03 13:07:01 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:04 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242" returned: 0 in 2.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99_zdgj1o_cdevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:07:04 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Converted 112.00 MB image at 46.61 MB/s Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:04 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 1G Nov 03 13:07:04 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:04 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 1G" returned: 0 in 0.403s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Downloaded image 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'metadata': {}}])) to volume 05779f36-e078-45a4-944b-fcb71b125242 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Temporary image 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 for user 545a522f52de482391392e1efd96dc2e is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Marking volume 05779f36-e078-45a4-944b-fcb71b125242 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Copying metadata from image 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 to 05779f36-e078-45a4-944b-fcb71b125242. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Creating volume glance metadata for volume 05779f36-e078-45a4-944b-fcb71b125242 backed by image 9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99 with: {'image_id': '9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'image_name': 'tempest-scenario-img--1025947902', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a89a54-b860-4e3d-9cf0-10372902f948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05779f36-e078-45a4-944b-fcb71b125242', 'volume_size': 1, 'image_id': '9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1025947902', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e9c2358d7df4864b76e9cc2f89772c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99', 'created_at': datetime.datetime(2026, 11, 3, 12, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d631dec-1ae3-4a5e-a2ed-3e12ba94ad99/file', 'properties': {}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4468267-f58b-4740-97e9-541fde7a82b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Volume volume-05779f36-e078-45a4-944b-fcb71b125242 (05779f36-e078-45a4-944b-fcb71b125242): created successfully Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4468267-f58b-4740-97e9-541fde7a82b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Flow 'volume_create_manager' (13c4d882-2b2e-4bd4-b23a-05c1ec56b275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-17805a8f-3e80-4b7e-9f65-73a4276e6c1c tempest-TestInstancesWithCinderVolumes-1911243997 None] Created volume successfully. Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Flow 'volume_create_manager' (0285d9e0-76e4-44aa-8da5-f8e0690b3a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d953b508-93e2-4788-a166-af5f9cb8aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d953b508-93e2-4788-a166-af5f9cb8aa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1673294345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e69e4c-4a13-4938-bc56-f758f177e310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42e32f43fd845b580621be58b410830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:05Z,use_quota=True,user_id='07674f5caddf49a6b563ecce927932ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1edb1da-5898-4338-b15f-f6a15ba5cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1edb1da-5898-4338-b15f-f6a15ba5cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880f347b-8495-40a4-b04f-565d020cf70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880f347b-8495-40a4-b04f-565d020cf70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62e69e4c-4a13-4938-bc56-f758f177e310', 'volume_name': 'volume-62e69e4c-4a13-4938-bc56-f758f177e310', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85220e83-303b-4013-83da-eb881786f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85220e83-303b-4013-83da-eb881786f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b96b83a-ad62-4027-b348-bd4ea13402cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Volume 62e69e4c-4a13-4938-bc56-f758f177e310: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62e69e4c-4a13-4938-bc56-f758f177e310', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Trying to clone 62e69e4c-4a13-4938-bc56-f758f177e310 from image 68321eb5-d635-47b3-850b-90ed52040d26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:07:05 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8db6ec8-e759-4636-b298-902c9eb24b62]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:06 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD Nov 03 13:07:06 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:06 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 is fetched for user 07674f5caddf49a6b563ecce927932ca. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ee0a3-9bfc-40db-868b-f39566575517]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:06 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD Nov 03 13:07:06 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:06 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1673294345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e69e4c-4a13-4938-bc56-f758f177e310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42e32f43fd845b580621be58b410830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:05Z,use_quota=True,user_id='07674f5caddf49a6b563ecce927932ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Creating volume 62e69e4c-4a13-4938-bc56-f758f177e310 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:06 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:07:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:06 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 1073741824 Nov 03 13:07:06 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:07 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 1073741824" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:07 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 Nov 03 13:07:07 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:07 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Attempting download of 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 62e69e4c-4a13-4938-bc56-f758f177e310. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a366b7-0156-4219-9a6d-cc0fe08e3bcd]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_eepb3kgn {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:08 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_eepb3kgn Nov 03 13:07:08 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:08 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_eepb3kgn" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_eepb3kgn {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:08 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_eepb3kgn Nov 03 13:07:08 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:08 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_eepb3kgn" returned: 1 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_eepb3kgn' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:07:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d5bbf-49ae-441c-b9a7-72fa1bd8f2bd]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:08 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD Nov 03 13:07:08 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:09 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:09 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] 68321eb5-d635-47b3-850b-90ed52040d26 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:07:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-235dcbf8-139d-4462-a218-d3ae714e711f req-c9aadfcb-ea83-466a-a43d-4f59f10a74c7 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-235dcbf8-139d-4462-a218-d3ae714e711f req-c9aadfcb-ea83-466a-a43d-4f59f10a74c7 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:09 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 Nov 03 13:07:09 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-235dcbf8-139d-4462-a218-d3ae714e711f req-c9aadfcb-ea83-466a-a43d-4f59f10a74c7 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-235dcbf8-139d-4462-a218-d3ae714e711f req-c9aadfcb-ea83-466a-a43d-4f59f10a74c7 tempest-TestInstancesWithCinderVolumes-1911243997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-05779f36-e078-45a4-944b-fcb71b125242', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '942db77f-e3d9-4fa5-9695-19c5db74d48e', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:07:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-235dcbf8-139d-4462-a218-d3ae714e711f req-c9aadfcb-ea83-466a-a43d-4f59f10a74c7 tempest-TestInstancesWithCinderVolumes-1911243997 None] attachment_update completed successfully. Nov 03 13:07:12 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310" returned: 0 in 2.789s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_0ft79q97devstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:07:12 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Converted 112.00 MB image at 40.14 MB/s Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:12 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 1G Nov 03 13:07:12 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:12 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 1G" returned: 0 in 0.662s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Downloaded image 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 62e69e4c-4a13-4938-bc56-f758f177e310 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 for user 07674f5caddf49a6b563ecce927932ca is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Marking volume 62e69e4c-4a13-4938-bc56-f758f177e310 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Copying metadata from image 68321eb5-d635-47b3-850b-90ed52040d26 to 62e69e4c-4a13-4938-bc56-f758f177e310. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Creating volume glance metadata for volume 62e69e4c-4a13-4938-bc56-f758f177e310 backed by image 68321eb5-d635-47b3-850b-90ed52040d26 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b96b83a-ad62-4027-b348-bd4ea13402cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e69e4c-4a13-4938-bc56-f758f177e310', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a90cf1-b97e-47b6-91ae-ee3170dbf061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Volume volume-62e69e4c-4a13-4938-bc56-f758f177e310 (62e69e4c-4a13-4938-bc56-f758f177e310): created successfully Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a90cf1-b97e-47b6-91ae-ee3170dbf061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Flow 'volume_create_manager' (0285d9e0-76e4-44aa-8da5-f8e0690b3a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7d6b89f6-c893-4d13-bed2-5025a00885ec tempest-VolumesImageMetadata-568406637 None] Created volume successfully. Nov 03 13:07:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Acquiring lock "cinder-62e69e4c-4a13-4938-bc56-f758f177e310-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Lock "cinder-62e69e4c-4a13-4938-bc56-f758f177e310-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Acquiring lock "cinder-quobyte-62e69e4c-4a13-4938-bc56-f758f177e310" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Lock "cinder-quobyte-62e69e4c-4a13-4938-bc56-f758f177e310" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf07cc1-77c5-4c7a-bc18-0313529fbb88]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:15 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 Nov 03 13:07:15 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:15 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Flow 'volume_create_manager' (3d202c9e-690d-47e8-9881-cee2997fc23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdfee5e-98f5-4ba1-9fda-b2cea6e532b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310" returned: 0 in 0.543s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdfee5e-98f5-4ba1-9fda-b2cea6e532b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2094671077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14de6db5-69dd-420e-aee7-618386311618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c407cf3bed45fa9124c8420436783b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:15Z,use_quota=True,user_id='5bea76340d75434c93b4db6303f29482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e4464f-e48e-4c1a-b0ab-1a1f5efbde75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e4464f-e48e-4c1a-b0ab-1a1f5efbde75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d83e4e0-3993-44a6-b44c-da993f842796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:15 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310 Nov 03 13:07:15 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d83e4e0-3993-44a6-b44c-da993f842796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14de6db5-69dd-420e-aee7-618386311618', 'volume_name': 'volume-14de6db5-69dd-420e-aee7-618386311618', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847d1e07-d8c2-4e61-bf58-2281aceeab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847d1e07-d8c2-4e61-bf58-2281aceeab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8840b117-0604-4db8-a8d9-bee8796c2dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Volume 14de6db5-69dd-420e-aee7-618386311618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14de6db5-69dd-420e-aee7-618386311618', 'volume_size': 1} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2094671077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14de6db5-69dd-420e-aee7-618386311618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c407cf3bed45fa9124c8420436783b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:15Z,use_quota=True,user_id='5bea76340d75434c93b4db6303f29482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Creating volume 14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:15 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:15 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 1073741824 Nov 03 13:07:15 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:15 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-62e69e4c-4a13-4938-bc56-f758f177e310" returned: 0 in 0.315s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Lock "cinder-quobyte-62e69e4c-4a13-4938-bc56-f758f177e310" released by "delete_volume" :: held 0.958s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Created reservations ['4918d8ab-52db-4ac9-a627-2128a21ab601', '51fb974c-115b-41db-9d3b-7653001ae278', '23ece521-eecc-4260-b0d2-c72d446f76d0', '6bac1054-77bd-46ee-a422-e13564473c77'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:16 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:07:16 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:16 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 1073741824" returned: 0 in 0.588s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:16 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 Nov 03 13:07:16 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:16 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.340s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Deleted volume successfully. Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7d1e6fd4-bcdb-4d6a-96af-13e2578cb019 tempest-VolumesImageMetadata-568406637 None] Lock "cinder-62e69e4c-4a13-4938-bc56-f758f177e310-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:16 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618" returned: 0 in 0.369s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8840b117-0604-4db8-a8d9-bee8796c2dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14de6db5-69dd-420e-aee7-618386311618', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b6e03b-6976-47c4-8e24-fb11f8ecdd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Volume volume-14de6db5-69dd-420e-aee7-618386311618 (14de6db5-69dd-420e-aee7-618386311618): created successfully Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b6e03b-6976-47c4-8e24-fb11f8ecdd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Flow 'volume_create_manager' (3d202c9e-690d-47e8-9881-cee2997fc23a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-42dda1b6-fd67-42ea-8cde-03041932960c tempest-SnapshotDependencyTests-499056526 None] Created volume successfully. Nov 03 13:07:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Creating offline snapshot 36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 of volume 14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:07:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[410061c8-0d66-44cb-8c85-c5f4d5d1622f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:18 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 Nov 03 13:07:18 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:18 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618" returned: 0 in 0.625s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:18 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 1G Nov 03 13:07:18 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:19 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 1G" returned: 0 in 0.793s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14de6db5-69dd-420e-aee7-618386311618 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:19 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14de6db5-69dd-420e-aee7-618386311618 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 Nov 03 13:07:19 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:20 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14de6db5-69dd-420e-aee7-618386311618 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" returned: 0 in 0.690s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:20 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 is being set with open permissions: ugo+rw Nov 03 13:07:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:20 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 Nov 03 13:07:20 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:20 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:20 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.info Nov 03 13:07:20 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:21 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.info" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:21 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.info is being set with open permissions: ugo+rw Nov 03 13:07:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:21 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.info Nov 03 13:07:21 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:21 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.info" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.313s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0c9fd30d-f39c-4a8c-8ae3-ba7f7dbe5fa6 tempest-SnapshotDependencyTests-499056526 None] Create snapshot completed successfully Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Flow 'volume_create_manager' (9ba3728f-4490-4554-8598-8925f25175a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b4d497-7e61-49d2-90c1-ca43fab66b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b4d497-7e61-49d2-90c1-ca43fab66b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4076f18a-cf82-472a-836d-33cbe4cf34d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c407cf3bed45fa9124c8420436783b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36221824-e3fe-4a1d-8b22-b63b4ce0f1a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:23Z,use_quota=True,user_id='5bea76340d75434c93b4db6303f29482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f8d6cf-37e3-4bc6-9dc9-32d0a432d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f8d6cf-37e3-4bc6-9dc9-32d0a432d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9905fd04-cd33-4511-8cb1-17299524ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9905fd04-cd33-4511-8cb1-17299524ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4076f18a-cf82-472a-836d-33cbe4cf34d5', 'volume_name': 'volume-4076f18a-cf82-472a-836d-33cbe4cf34d5', 'volume_size': 1, 'snapshot_id': '36221824-e3fe-4a1d-8b22-b63b4ce0f1a2'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d621282-ad71-4e2c-ba0c-a337100cbb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d621282-ad71-4e2c-ba0c-a337100cbb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8afa9c-882a-471e-8fa8-fe6f6b003933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Volume 4076f18a-cf82-472a-836d-33cbe4cf34d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4076f18a-cf82-472a-836d-33cbe4cf34d5', 'volume_size': 1, 'snapshot_id': '36221824-e3fe-4a1d-8b22-b63b4ce0f1a2'} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-quobyte-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2-4076f18a-cf82-472a-836d-33cbe4cf34d5" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2-4076f18a-cf82-472a-836d-33cbe4cf34d5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Creating volume 4076f18a-cf82-472a-836d-33cbe4cf34d5 from snapshot 36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-quobyte-4076f18a-cf82-472a-836d-33cbe4cf34d5" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-4076f18a-cf82-472a-836d-33cbe4cf34d5" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] snapshot: 36221824-e3fe-4a1d-8b22-b63b4ce0f1a2, volume: 4076f18a-cf82-472a-836d-33cbe4cf34d5, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd5725-e22b-4405-883f-5bd825668594]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:23 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 Nov 03 13:07:23 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:24 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" returned: 0 in 0.615s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14de6db5-69dd-420e-aee7-618386311618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[11afba61-cee6-4102-aed3-abc7b9ea2011]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:24 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 Nov 03 13:07:24 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:24 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:24 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 Nov 03 13:07:24 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Flow 'volume_create_manager' (26db5246-f274-4af7-a7ce-b7c5315c165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6c6728-fa54-4054-ad5b-4fcb3b30799e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6c6728-fa54-4054-ad5b-4fcb3b30799e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1690177577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12800f65-9dbe-4c70-a87c-3b731028aad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a579c2b5587450ebb3e1ff0142ecbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:25Z,use_quota=True,user_id='5fc7267d20484794b2c2eb1a20941a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d79376-7f73-4e6e-a5d1-33fcbdbb1cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d79376-7f73-4e6e-a5d1-33fcbdbb1cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfb22d7-eeac-4ab9-b99e-31c457bd7931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfb22d7-eeac-4ab9-b99e-31c457bd7931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12800f65-9dbe-4c70-a87c-3b731028aad8', 'volume_name': 'volume-12800f65-9dbe-4c70-a87c-3b731028aad8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e5936b-26fb-41e4-a585-ded1f6ae9643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e5936b-26fb-41e4-a585-ded1f6ae9643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84c9ec0-762f-443e-ad67-ce618592e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Volume 12800f65-9dbe-4c70-a87c-3b731028aad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12800f65-9dbe-4c70-a87c-3b731028aad8', 'volume_size': 1} Nov 03 13:07:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:31 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5" returned: 0 in 7.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:31 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:07:31 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Converted 1024.00 MB image at 139.07 MB/s Nov 03 13:07:31 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 is being set with open permissions: ugo+rw Nov 03 13:07:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:31 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 Nov 03 13:07:31 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:32 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-4076f18a-cf82-472a-836d-33cbe4cf34d5" released by "_copy_volume_from_snapshot" :: held 8.899s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2-4076f18a-cf82-472a-836d-33cbe4cf34d5" released by "_create_volume_from_snapshot" :: held 9.006s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.032s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.352s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1690177577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12800f65-9dbe-4c70-a87c-3b731028aad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a579c2b5587450ebb3e1ff0142ecbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:25Z,use_quota=True,user_id='5fc7267d20484794b2c2eb1a20941a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Creating volume 12800f65-9dbe-4c70-a87c-3b731028aad8 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:32 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 1073741824 Nov 03 13:07:32 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8afa9c-882a-471e-8fa8-fe6f6b003933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4076f18a-cf82-472a-836d-33cbe4cf34d5', 'volume_size': 1, 'snapshot_id': '36221824-e3fe-4a1d-8b22-b63b4ce0f1a2'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0791d3-c1f5-48f3-a838-f64388761fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Volume volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 (4076f18a-cf82-472a-836d-33cbe4cf34d5): created successfully Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0791d3-c1f5-48f3-a838-f64388761fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Flow 'volume_create_manager' (9ba3728f-4490-4554-8598-8925f25175a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9f52fa6b-2c23-4f93-874c-9e59131e6187 tempest-SnapshotDependencyTests-499056526 None] Created volume successfully. Nov 03 13:07:32 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 1073741824" returned: 0 in 0.436s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:32 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 Nov 03 13:07:32 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:33 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-quobyte-14de6db5-69dd-420e-aee7-618386311618" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-14de6db5-69dd-420e-aee7-618386311618" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-quobyte-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84c9ec0-762f-443e-ad67-ce618592e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12800f65-9dbe-4c70-a87c-3b731028aad8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b2cc3e-9946-496c-ad16-728b334d65fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Deleting offline snapshot 36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 of volume 14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] snapshot_file for this snap is: volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:07:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Volume volume-12800f65-9dbe-4c70-a87c-3b731028aad8 (12800f65-9dbe-4c70-a87c-3b731028aad8): created successfully Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b2cc3e-9946-496c-ad16-728b334d65fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Flow 'volume_create_manager' (26db5246-f274-4af7-a7ce-b7c5315c165a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7a242-b522-46f9-b2c1-3b48ed6b5b7e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-46c4bf9c-6131-4822-b1a6-928b1600d1f2 tempest-VolumesTransfersV357Test-958761098 None] Created volume successfully. Nov 03 13:07:33 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 Nov 03 13:07:33 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:33 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14de6db5-69dd-420e-aee7-618386311618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c89c2a-4ba2-4dc5-aa89-0797e87ca156]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:33 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 Nov 03 13:07:33 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:34 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:34 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 Nov 03 13:07:34 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3db4162e-d618-4772-8dcd-84b51f3511c9 tempest-VolumesTransfersV357Test-1083929619 None] Transfer volume completed successfully. Nov 03 13:07:34 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:34 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2 Nov 03 13:07:34 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Acquiring lock "cinder-12800f65-9dbe-4c70-a87c-3b731028aad8-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-12800f65-9dbe-4c70-a87c-3b731028aad8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:34 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618.36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Acquiring lock "cinder-quobyte-12800f65-9dbe-4c70-a87c-3b731028aad8" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2" released by "_delete_snapshot" :: held 1.674s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-14de6db5-69dd-420e-aee7-618386311618" released by "delete_snapshot" :: held 1.705s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-quobyte-12800f65-9dbe-4c70-a87c-3b731028aad8" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d2eec8-1e00-4fa4-95d8-f074fbb9b7e3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Created reservations ['eb2a225e-106e-4dd5-a2ac-60e53beed8cf', '203db760-49c9-4945-8b96-1eb2e6a9afc4', '28f8e4ec-87da-4ee3-85b1-2643b13507bc', '34b50475-100f-4837-8e19-42960f5b700e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Delete snapshot completed successfully. Nov 03 13:07:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1e1b6d4-e9c5-43ad-b8e9-fc050e9d020a tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-36221824-e3fe-4a1d-8b22-b63b4ce0f1a2-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:34 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 Nov 03 13:07:34 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:35 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-14de6db5-69dd-420e-aee7-618386311618-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:35 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8 Nov 03 13:07:35 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-14de6db5-69dd-420e-aee7-618386311618-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-quobyte-14de6db5-69dd-420e-aee7-618386311618" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-14de6db5-69dd-420e-aee7-618386311618" acquired by "delete_volume" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e04e4-5b7a-44f5-8d32-c9bcfeb4c9d6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:35 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 Nov 03 13:07:35 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:35 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12800f65-9dbe-4c70-a87c-3b731028aad8" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-quobyte-12800f65-9dbe-4c70-a87c-3b731028aad8" released by "delete_volume" :: held 0.697s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Created reservations ['db92e2b2-8680-4eda-b40e-30ccf893fb7e', '04c54285-a6e4-4caa-8056-60403fc6803a', '32055791-3914-49dc-a527-098015e3c51d', '4c0e62a8-31c8-489e-8a29-483b5349908a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:35 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:07:35 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:35 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618" returned: 0 in 0.392s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:35 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618 Nov 03 13:07:35 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:35 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Deleted volume successfully. Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df7c6190-0e64-4956-a5f1-1b896570c773 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-12800f65-9dbe-4c70-a87c-3b731028aad8-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:35 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-14de6db5-69dd-420e-aee7-618386311618" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-14de6db5-69dd-420e-aee7-618386311618" released by "delete_volume" :: held 0.736s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Created reservations ['c83e3539-e327-461b-9056-242a01f7fbf9', '1a283236-da11-4ff4-b1bc-53cb3860b6bc', '5ae727d0-c9c6-4446-9af4-3868af208f99', '982ef81b-b735-43dc-9b85-09d04c5883a2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:36 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:07:36 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-4076f18a-cf82-472a-836d-33cbe4cf34d5-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:36 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Flow 'volume_create_manager' (25aa0791-03e2-47ab-bf2a-39e01d638ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e84cea-f14b-48cc-9a3a-b8a2d38db51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Deleted volume successfully. Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e84cea-f14b-48cc-9a3a-b8a2d38db51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-152438538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e76534-49b5-409a-a99b-fee9fff30791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a579c2b5587450ebb3e1ff0142ecbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:36Z,use_quota=True,user_id='5fc7267d20484794b2c2eb1a20941a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb32214-13f1-4698-b1af-5374b67e6021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb32214-13f1-4698-b1af-5374b67e6021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7914eed9-87be-4d21-8831-2c717e7e0ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7914eed9-87be-4d21-8831-2c717e7e0ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e76534-49b5-409a-a99b-fee9fff30791', 'volume_name': 'volume-54e76534-49b5-409a-a99b-fee9fff30791', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae801460-8e6b-4a43-b7c9-48e70c5650bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae801460-8e6b-4a43-b7c9-48e70c5650bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bb82f3-29de-4415-8b13-5d684698c852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Volume 54e76534-49b5-409a-a99b-fee9fff30791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e76534-49b5-409a-a99b-fee9fff30791', 'volume_size': 1} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-152438538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e76534-49b5-409a-a99b-fee9fff30791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a579c2b5587450ebb3e1ff0142ecbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:36Z,use_quota=True,user_id='5fc7267d20484794b2c2eb1a20941a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Creating volume 54e76534-49b5-409a-a99b-fee9fff30791 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:36 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-4076f18a-cf82-472a-836d-33cbe4cf34d5-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:36 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 1073741824 Nov 03 13:07:36 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4920c6fa-5f8f-45d2-9705-f1dbb609ec80 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-14de6db5-69dd-420e-aee7-618386311618-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "cinder-quobyte-4076f18a-cf82-472a-836d-33cbe4cf34d5" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-4076f18a-cf82-472a-836d-33cbe4cf34d5" acquired by "delete_volume" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3e0bae-5606-46e0-ace1-be8472885f2f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:36 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 Nov 03 13:07:36 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:36 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 1073741824" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:36 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 Nov 03 13:07:36 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:37 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5" returned: 0 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:37 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5 Nov 03 13:07:37 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:37 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bb82f3-29de-4415-8b13-5d684698c852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e76534-49b5-409a-a99b-fee9fff30791', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15217fb-68d5-4875-8dc9-3942347c7e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:37 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Volume volume-54e76534-49b5-409a-a99b-fee9fff30791 (54e76534-49b5-409a-a99b-fee9fff30791): created successfully Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15217fb-68d5-4875-8dc9-3942347c7e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Flow 'volume_create_manager' (25aa0791-03e2-47ab-bf2a-39e01d638ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4076f18a-cf82-472a-836d-33cbe4cf34d5" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-quobyte-4076f18a-cf82-472a-836d-33cbe4cf34d5" released by "delete_volume" :: held 0.721s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-30c8fe85-3e6d-43dc-a0c5-1526860c4430 tempest-VolumesTransfersV357Test-958761098 None] Created volume successfully. Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Created reservations ['10730bcf-93c1-4f8a-adc7-208757afd1c1', 'e3b4e3d6-8fb2-468b-843f-f61e98660c3c', 'f4b81c41-c9c8-4c51-9bef-fd397b775823', 'c3fd09b3-f6ea-4910-bdcd-3683121edb2e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:37 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:07:37 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:37 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Deleted volume successfully. Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Acquiring lock "cinder-54e76534-49b5-409a-a99b-fee9fff30791-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-54e76534-49b5-409a-a99b-fee9fff30791-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f52cdc69-edff-44e6-a323-fffb5f346c79 tempest-SnapshotDependencyTests-499056526 None] Lock "cinder-4076f18a-cf82-472a-836d-33cbe4cf34d5-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Acquiring lock "cinder-quobyte-54e76534-49b5-409a-a99b-fee9fff30791" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-quobyte-54e76534-49b5-409a-a99b-fee9fff30791" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f323ecc-14ed-4976-9dc2-adf7186e4808]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:37 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 Nov 03 13:07:37 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:38 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:38 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791 Nov 03 13:07:38 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:38 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-54e76534-49b5-409a-a99b-fee9fff30791" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-quobyte-54e76534-49b5-409a-a99b-fee9fff30791" released by "delete_volume" :: held 0.712s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Created reservations ['fefe17e3-9d53-4e47-b0af-7e1f10a5b433', '4fd25d11-ac32-4577-a073-ea9e8ecc2f75', '17288896-b929-4b04-9e38-1fc33939e62e', '5a682a5f-6226-41d2-bd2a-184fa8591b94'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:38 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:07:38 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:39 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.347s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Deleted volume successfully. Nov 03 13:07:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dba27a2a-7d19-4ce0-9afc-4a02f1bcf6c6 tempest-VolumesTransfersV357Test-1779147520 None] Lock "cinder-54e76534-49b5-409a-a99b-fee9fff30791-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ac84a0ec-2fcb-4b30-8f81-031e30c50218 req-3f42874b-f9b8-4f28-a490-7e72c0816950 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ac84a0ec-2fcb-4b30-8f81-031e30c50218 req-3f42874b-f9b8-4f28-a490-7e72c0816950 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ac84a0ec-2fcb-4b30-8f81-031e30c50218 req-3f42874b-f9b8-4f28-a490-7e72c0816950 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ac84a0ec-2fcb-4b30-8f81-031e30c50218 req-3f42874b-f9b8-4f28-a490-7e72c0816950 tempest-TestInstancesWithCinderVolumes-1911243997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfd323f6-5cfb-4223-b639-81df2d34d337', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:07:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-ac84a0ec-2fcb-4b30-8f81-031e30c50218 req-3f42874b-f9b8-4f28-a490-7e72c0816950 tempest-TestInstancesWithCinderVolumes-1911243997 None] attachment_update completed successfully. Nov 03 13:07:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=77,cinder:INSERT=27,cinder:UPDATE=82,cinder:DELETE=6 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:07:48 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=73,cinder:SELECT=82,cinder:INSERT=28,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:07:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-65abda7e-07d7-4ffb-b60e-0783a645d1cf req-5f4f00e0-e1f1-4f35-8100-654b3f9695f3 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-65abda7e-07d7-4ffb-b60e-0783a645d1cf req-5f4f00e0-e1f1-4f35-8100-654b3f9695f3 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-65abda7e-07d7-4ffb-b60e-0783a645d1cf req-5f4f00e0-e1f1-4f35-8100-654b3f9695f3 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-65abda7e-07d7-4ffb-b60e-0783a645d1cf req-5f4f00e0-e1f1-4f35-8100-654b3f9695f3 tempest-TestInstancesWithCinderVolumes-1911243997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-68e2519c-137c-4f16-beaf-712ecf346a19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8bf22ed-646a-48f0-a545-8dbdad897eb7', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:07:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-65abda7e-07d7-4ffb-b60e-0783a645d1cf req-5f4f00e0-e1f1-4f35-8100-654b3f9695f3 tempest-TestInstancesWithCinderVolumes-1911243997 None] attachment_update completed successfully. Nov 03 13:07:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-7335cbc9-f3a1-432a-8e2a-cc2dc78b3eb3 req-b02d70ac-aca6-43a8-af83-00fac22cceb3 tempest-TestInstancesWithCinderVolumes-1911243997 None] Terminate volume connection completed successfully. Nov 03 13:07:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-7335cbc9-f3a1-432a-8e2a-cc2dc78b3eb3 req-b02d70ac-aca6-43a8-af83-00fac22cceb3 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deleting attachment cfd323f6-5cfb-4223-b639-81df2d34d337. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "cinder-b79e9945-588b-4a9c-a49e-25107b1c8bcc-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-b79e9945-588b-4a9c-a49e-25107b1c8bcc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "cinder-quobyte-b79e9945-588b-4a9c-a49e-25107b1c8bcc" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-quobyte-b79e9945-588b-4a9c-a49e-25107b1c8bcc" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ccb84-ced8-4b54-b5b1-ddb58f6989ef]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:55 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc Nov 03 13:07:55 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:55 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc" returned: 0 in 0.437s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:55 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc Nov 03 13:07:55 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:56 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b79e9945-588b-4a9c-a49e-25107b1c8bcc" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-quobyte-b79e9945-588b-4a9c-a49e-25107b1c8bcc" released by "delete_volume" :: held 0.826s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:56 devstack cinder-volume[86369]: WARNING cinder.quota [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2048743994-228998063 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2048743994-228998063, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:07:56 devstack cinder-volume[86369]: WARNING cinder.quota [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2048743994-228998063 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2048743994-228998063, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Created reservations ['439505b9-c3d7-4fd4-91ee-dd3d32a05d03', '003a8163-4000-40ea-b41f-63f8c9906e49', '15d348b8-f529-4e91-886d-d12e196d4605', 'bd4c67db-e796-4621-b040-e5f2a9232954'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:56 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:07:56 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:56 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.367s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:56 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deleted volume successfully. Nov 03 13:07:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cde3a435-f9ca-42b4-9b8d-f136fa75c3d6 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-b79e9945-588b-4a9c-a49e-25107b1c8bcc-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Flow 'volume_create_manager' (b371013d-be63-43e8-ba5c-3192db685666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed65027-d003-4864-accf-5ef3dbf8a069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed65027-d003-4864-accf-5ef3dbf8a069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845140001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16de0b26-aef7-456e-8b23-e88d549a270a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ab41967b94591b2f46060806fff84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:58Z,use_quota=True,user_id='dcadb9d1479e4e6abcbd49aa2132176f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f063f48b-9172-48d0-9379-0fb1c5d9429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f063f48b-9172-48d0-9379-0fb1c5d9429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37722df0-0178-40b5-8b26-003aeebd05f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37722df0-0178-40b5-8b26-003aeebd05f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16de0b26-aef7-456e-8b23-e88d549a270a', 'volume_name': 'volume-16de0b26-aef7-456e-8b23-e88d549a270a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300f9024-53be-4348-8c9f-cabf9f3ad6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300f9024-53be-4348-8c9f-cabf9f3ad6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72afea91-96d1-4b1c-a45d-a22a112d0fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:58 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Volume 16de0b26-aef7-456e-8b23-e88d549a270a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16de0b26-aef7-456e-8b23-e88d549a270a', 'volume_size': 1} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845140001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16de0b26-aef7-456e-8b23-e88d549a270a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22ab41967b94591b2f46060806fff84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:07:58Z,use_quota=True,user_id='dcadb9d1479e4e6abcbd49aa2132176f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Creating volume 16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:07:58 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:58 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a 1073741824 Nov 03 13:07:58 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:58 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a 1073741824" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:58 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:07:58 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:07:58 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:07:58 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:07:58 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72afea91-96d1-4b1c-a45d-a22a112d0fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16de0b26-aef7-456e-8b23-e88d549a270a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5808877-af20-41fb-80af-c112bbb90e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:07:58 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Volume volume-16de0b26-aef7-456e-8b23-e88d549a270a (16de0b26-aef7-456e-8b23-e88d549a270a): created successfully Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5808877-af20-41fb-80af-c112bbb90e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:07:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Flow 'volume_create_manager' (b371013d-be63-43e8-ba5c-3192db685666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:07:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6194eb3c-a44e-4097-8aca-be5a3496dfa5 tempest-VolumesActionsTest-1168974023 None] Created volume successfully. Nov 03 13:07:58 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Nov 03 13:07:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:07:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:07:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:07:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:07:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:07:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-ee2938a8-e86c-415c-a989-fd014b38c4ce req-a64220cc-7642-4483-ba38-55bc08363f82 tempest-TestInstancesWithCinderVolumes-1911243997 None] Terminate volume connection completed successfully. Nov 03 13:07:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ee2938a8-e86c-415c-a989-fd014b38c4ce req-a64220cc-7642-4483-ba38-55bc08363f82 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deleting attachment e8bf22ed-646a-48f0-a545-8dbdad897eb7. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "cinder-68e2519c-137c-4f16-beaf-712ecf346a19-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-68e2519c-137c-4f16-beaf-712ecf346a19-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "cinder-quobyte-68e2519c-137c-4f16-beaf-712ecf346a19" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-quobyte-68e2519c-137c-4f16-beaf-712ecf346a19" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ca2272-f9a2-40a3-a753-b38229191f81]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:00 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 Nov 03 13:08:00 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:00 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19" returned: 0 in 0.430s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:00 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19 Nov 03 13:08:00 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:01 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-68e2519c-137c-4f16-beaf-712ecf346a19" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-quobyte-68e2519c-137c-4f16-beaf-712ecf346a19" released by "delete_volume" :: held 0.791s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:01 devstack cinder-volume[86369]: WARNING cinder.quota [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909756390-482438044 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909756390-482438044, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:08:01 devstack cinder-volume[86369]: WARNING cinder.quota [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909756390-482438044 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909756390-482438044, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Created reservations ['3baad951-87f7-4bed-8696-08bb5929bfb2', 'dccb1873-4609-4091-9ae8-10351b8beca4', 'b2c4607c-a472-446d-bd41-b9580e23d375', '58bbee13-b248-40cb-a5f5-921cbd32cb15'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:01 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:08:01 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:01 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.343s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Deleted volume successfully. Nov 03 13:08:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50994e11-e6f2-4381-94b8-17ddb2f74d6d tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-68e2519c-137c-4f16-beaf-712ecf346a19-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-f90494b7-2123-4479-ad57-6f06fb2d9735 req-95b3c979-b7b1-49b7-a53e-74b1ec0ca719 tempest-TestInstancesWithCinderVolumes-1911243997 None] Terminate volume connection completed successfully. Nov 03 13:08:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-f90494b7-2123-4479-ad57-6f06fb2d9735 req-95b3c979-b7b1-49b7-a53e-74b1ec0ca719 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deleting attachment 942db77f-e3d9-4fa5-9695-19c5db74d48e. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:08:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "cinder-05779f36-e078-45a4-944b-fcb71b125242-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-05779f36-e078-45a4-944b-fcb71b125242-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "cinder-quobyte-05779f36-e078-45a4-944b-fcb71b125242" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-quobyte-05779f36-e078-45a4-944b-fcb71b125242" acquired by "delete_volume" :: waited 0.051s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a33c9b2-9f06-4298-a992-0c3f475294a1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:06 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 Nov 03 13:08:06 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:07 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:07 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242 Nov 03 13:08:07 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:07 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-05779f36-e078-45a4-944b-fcb71b125242" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-quobyte-05779f36-e078-45a4-944b-fcb71b125242" released by "delete_volume" :: held 0.789s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:07 devstack cinder-volume[86369]: WARNING cinder.quota [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801844998-1370566080 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801844998-1370566080, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:08:07 devstack cinder-volume[86369]: WARNING cinder.quota [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801844998-1370566080 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801844998-1370566080, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Created reservations ['fdfe8eee-7e0f-4d47-bb77-121f2e29f50a', '38921950-2a2e-444a-bbac-ef13cca2f1c7', '9d31948e-7633-4260-897c-8766e1205544', '4aba0020-cb78-438e-b684-567cc54ad263'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:07 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:08:07 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:07 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Deleted volume successfully. Nov 03 13:08:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff3d0e2c-49ba-4e39-807a-63fcb11da630 tempest-TestInstancesWithCinderVolumes-1911243997 None] Lock "cinder-05779f36-e078-45a4-944b-fcb71b125242-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3318d6d5-6b0c-4293-801e-62cae8c57570 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a" by "attach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3318d6d5-6b0c-4293-801e-62cae8c57570 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a" acquired by "attach_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3318d6d5-6b0c-4293-801e-62cae8c57570 tempest-VolumesActionsTest-1168974023 None] Attaching volume 16de0b26-aef7-456e-8b23-e88d549a270a to instance 87618b0d-c3e9-4cc7-8e11-f3d0c6bb550e at mountpoint /dev/vdb on host None. Nov 03 13:08:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3318d6d5-6b0c-4293-801e-62cae8c57570 tempest-VolumesActionsTest-1168974023 None] Attach volume completed successfully. Nov 03 13:08:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3318d6d5-6b0c-4293-801e-62cae8c57570 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a" released by "attach_volume" :: held 0.098s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02730cd4-edc7-484d-8cac-efa0f4be84d6 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02730cd4-edc7-484d-8cac-efa0f4be84d6 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-02730cd4-edc7-484d-8cac-efa0f4be84d6 tempest-VolumesActionsTest-1168974023 None] Detaching volume 16de0b26-aef7-456e-8b23-e88d549a270a from instance 87618b0d-c3e9-4cc7-8e11-f3d0c6bb550e. Nov 03 13:08:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-02730cd4-edc7-484d-8cac-efa0f4be84d6 tempest-VolumesActionsTest-1168974023 None] Detach volume completed successfully. Nov 03 13:08:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02730cd4-edc7-484d-8cac-efa0f4be84d6 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:18 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=34,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:18 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=34,cinder:SELECT=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-23e1bc59-ccec-4f55-843a-bdd2debef661 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a" by "attach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-23e1bc59-ccec-4f55-843a-bdd2debef661 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a" acquired by "attach_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-23e1bc59-ccec-4f55-843a-bdd2debef661 tempest-VolumesActionsTest-1168974023 None] Attaching volume 16de0b26-aef7-456e-8b23-e88d549a270a to instance bd28783d-7a45-4422-ab16-211564b3e40c at mountpoint /dev/vdb on host None. Nov 03 13:08:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-23e1bc59-ccec-4f55-843a-bdd2debef661 tempest-VolumesActionsTest-1168974023 None] Attach volume completed successfully. Nov 03 13:08:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-23e1bc59-ccec-4f55-843a-bdd2debef661 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a" released by "attach_volume" :: held 0.121s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea59ee2b-bd12-4185-a894-317c4041ba7d tempest-VolumesActionsTest-1168974023 None] Acquiring lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:08:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea59ee2b-bd12-4185-a894-317c4041ba7d tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:08:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ea59ee2b-bd12-4185-a894-317c4041ba7d tempest-VolumesActionsTest-1168974023 None] Detaching volume 16de0b26-aef7-456e-8b23-e88d549a270a from instance bd28783d-7a45-4422-ab16-211564b3e40c. Nov 03 13:08:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ea59ee2b-bd12-4185-a894-317c4041ba7d tempest-VolumesActionsTest-1168974023 None] Detach volume completed successfully. Nov 03 13:08:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea59ee2b-bd12-4185-a894-317c4041ba7d tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:08:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8c09f2-eeb0-4ca8-ab2e-45716ee32f12]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:25 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:08:25 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:25 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.374s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[534b3892-493f-451d-bc89-4841d23e4ea6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:25 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:08:25 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:26 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.0c0cc778-ee37-42ed-b02e-08acee771ae9o6ng1te8.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:26 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.0c0cc778-ee37-42ed-b02e-08acee771ae9o6ng1te8.img Nov 03 13:08:26 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:30 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:33 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.0c0cc778-ee37-42ed-b02e-08acee771ae9o6ng1te8.img" returned: 0 in 7.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc4ab38-65ba-4a4d-8835-fb129a18cf30]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:33 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:08:33 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:34 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.576s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:34 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.0c0cc778-ee37-42ed-b02e-08acee771ae9o6ng1te8.img {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:08:34 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Converted 1024.00 MB image at 137.38 MB/s Nov 03 13:08:34 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] 0c0cc778-ee37-42ed-b02e-08acee771ae9 was raw, no need to convert to raw {{(pid=86369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:INSERT=1,cinder:SELECT=8,cinder:UPDATE=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Flow 'volume_create_manager' (f5dfb1b6-fcf3-4400-98e4-361552e90476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdc8410-c6a0-4f8f-ad2e-c39e11073719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdc8410-c6a0-4f8f-ad2e-c39e11073719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-552740267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ceab7a-10e1-4f81-91e9-15644ec9aea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7450b16d6fe406bbf98c0a86b0f7a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:44Z,use_quota=True,user_id='34a1030d0a5c4b60a10a5846a1b650b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c71b830-f7ee-448c-9d76-482244284c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c71b830-f7ee-448c-9d76-482244284c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3e96da-942b-4e8d-8054-5a002f4ec57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3e96da-942b-4e8d-8054-5a002f4ec57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ceab7a-10e1-4f81-91e9-15644ec9aea9', 'volume_name': 'volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5ff072-1ef3-4e97-a9a0-ba9ae301eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5ff072-1ef3-4e97-a9a0-ba9ae301eea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4605490b-4b46-452a-bfab-289c24fd6759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Volume e4ceab7a-10e1-4f81-91e9-15644ec9aea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9', 'volume_size': 1} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Flow 'volume_create_manager' (c5532cea-a276-4be7-bfb8-ced5ee2c450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7434b81-de69-4308-92e2-60d744921930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7434b81-de69-4308-92e2-60d744921930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1229716813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9e89d1-7dd3-439e-9dc3-619be34be29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7450b16d6fe406bbf98c0a86b0f7a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:45Z,use_quota=True,user_id='34a1030d0a5c4b60a10a5846a1b650b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c2aa84-4bba-46c0-9144-12373b659223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c2aa84-4bba-46c0-9144-12373b659223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf6d3b7-e828-43d1-8491-854a170611d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf6d3b7-e828-43d1-8491-854a170611d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9e89d1-7dd3-439e-9dc3-619be34be29f', 'volume_name': 'volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328ffbbc-8c92-4f57-aba8-d796d8d1f271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328ffbbc-8c92-4f57-aba8-d796d8d1f271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb9b4b9-cc5f-45b1-8439-1ebd46ed384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Volume 7a9e89d1-7dd3-439e-9dc3-619be34be29f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f', 'volume_size': 1} Nov 03 13:08:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:54 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:54 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=3 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.397s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Uploaded volume to glance image-id: 0c0cc778-ee37-42ed-b02e-08acee771ae9. {{(pid=86369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.229s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-552740267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ceab7a-10e1-4f81-91e9-15644ec9aea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7450b16d6fe406bbf98c0a86b0f7a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:44Z,use_quota=True,user_id='34a1030d0a5c4b60a10a5846a1b650b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Creating volume e4ceab7a-10e1-4f81-91e9-15644ec9aea9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:08:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:56 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 1073741824 Nov 03 13:08:56 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fdebb767-1f43-4ccb-8c80-62d38d5e6bae tempest-VolumesActionsTest-1168974023 None] Copy volume to image completed successfully. Nov 03 13:08:57 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 1073741824" returned: 0 in 0.584s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:57 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 Nov 03 13:08:57 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:57 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.763s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1229716813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9e89d1-7dd3-439e-9dc3-619be34be29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7450b16d6fe406bbf98c0a86b0f7a7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:08:45Z,use_quota=True,user_id='34a1030d0a5c4b60a10a5846a1b650b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Creating volume 7a9e89d1-7dd3-439e-9dc3-619be34be29f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:08:57 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4605490b-4b46-452a-bfab-289c24fd6759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:57 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f 1073741824 Nov 03 13:08:57 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67def596-27b2-4d00-a837-a208e2b7e0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Volume volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 (e4ceab7a-10e1-4f81-91e9-15644ec9aea9): created successfully Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67def596-27b2-4d00-a837-a208e2b7e0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Flow 'volume_create_manager' (f5dfb1b6-fcf3-4400-98e4-361552e90476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-101c0fe3-96de-43a3-8560-cd521dd55823 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Created volume successfully. Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:58 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f 1073741824" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:58 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f Nov 03 13:08:58 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:58 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.429s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb9b4b9-cc5f-45b1-8439-1ebd46ed384f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088c075f-b928-44b6-971b-554a7eebabfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[445cdfa6-c5f5-4bf3-a911-69eca8d1874c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:58 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Volume volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f (7a9e89d1-7dd3-439e-9dc3-619be34be29f): created successfully Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088c075f-b928-44b6-971b-554a7eebabfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Flow 'volume_create_manager' (c5532cea-a276-4be7-bfb8-ced5ee2c450e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:08:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d851f932-040a-40c2-a9d9-7d06ef67b050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Created volume successfully. Nov 03 13:08:58 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:08:58 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:58 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:08:58 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:58 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.402s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[308ebe16-fde9-4a2c-98a5-73ac97040129]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:58 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:08:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:08:59 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:08:59 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:08:59 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Nov 03 13:08:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.369s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:08:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:08:59 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img Nov 03 13:08:59 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:05 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img" returned: 0 in 6.217s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe69469-8246-4dc2-be63-665d187b801f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:05 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:09:05 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:06 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:09:06 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Converted 1024.00 MB image at 164.69 MB/s Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] 55619810-38bf-4e70-872b-a68fd60d1548 was raw, converting to qcow2 {{(pid=86369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea9b662-6b8d-4f08-a9cd-17e9f2e40b7e]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:06 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img Nov 03 13:09:06 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:06 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:06 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img Nov 03 13:09:06 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:06 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img" returned: 1 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:09:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img /opt/stack/data/cinder/conversion/vol_upload_x8efd1hd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:06 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img /opt/stack/data/cinder/conversion/vol_upload_x8efd1hd Nov 03 13:09:06 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:06 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img /opt/stack/data/cinder/conversion/vol_upload_x8efd1hd" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:07 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Image conversion details: src /opt/stack/data/cinder/conversion/16de0b26-aef7-456e-8b23-e88d549a270a.temp_image.55619810-38bf-4e70-872b-a68fd60d15487vzzwb6a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_x8efd1hd {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:09:07 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 13:09:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d41ace-d82d-42f7-8e09-996f8bdaab47]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x8efd1hd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:07 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x8efd1hd Nov 03 13:09:07 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:07 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x8efd1hd" returned: 0 in 0.339s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.172s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Uploaded volume to glance image-id: 55619810-38bf-4e70-872b-a68fd60d1548. {{(pid=86369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 13:09:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2d34b356-934a-4343-8eb0-2075cf1750a1 tempest-VolumesActionsTest-1168974023 None] Copy volume to image completed successfully. Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "cinder-quobyte-16de0b26-aef7-456e-8b23-e88d549a270a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-quobyte-16de0b26-aef7-456e-8b23-e88d549a270a" acquired by "delete_volume" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe11b014-3193-442a-a94a-4d984eee68d6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:10 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:09:10 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:10 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:10 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a Nov 03 13:09:10 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:10 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-16de0b26-aef7-456e-8b23-e88d549a270a" returned: 0 in 0.238s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-quobyte-16de0b26-aef7-456e-8b23-e88d549a270a" released by "delete_volume" :: held 0.626s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Created reservations ['81567bd1-827b-434c-acea-51a90f133074', '727c0a4c-0763-452d-8ebd-2b8f2a794a30', 'dbf44790-3c49-4634-9080-5a1ec705bf35', '45f70565-92ce-4ac6-9546-97e9157dabce'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:11 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:11 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:11 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.234s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Deleted volume successfully. Nov 03 13:09:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-215471b0-63b7-449a-8b75-f4580effacc6 tempest-VolumesActionsTest-1168974023 None] Lock "cinder-16de0b26-aef7-456e-8b23-e88d549a270a-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-8fcafbee-80dc-4975-a29f-1d6a218eb997 req-ede255e7-87d9-4381-bc00-60f02a5d5c0d tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-8fcafbee-80dc-4975-a29f-1d6a218eb997 req-ede255e7-87d9-4381-bc00-60f02a5d5c0d tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-8fcafbee-80dc-4975-a29f-1d6a218eb997 req-ede255e7-87d9-4381-bc00-60f02a5d5c0d tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-8fcafbee-80dc-4975-a29f-1d6a218eb997 req-ede255e7-87d9-4381-bc00-60f02a5d5c0d tempest-TestServerVolumeAttachmentScenario-1063275284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4f7a16d-0786-4b0a-bf25-45fd3db9c93d', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:09:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-8fcafbee-80dc-4975-a29f-1d6a218eb997 req-ede255e7-87d9-4381-bc00-60f02a5d5c0d tempest-TestServerVolumeAttachmentScenario-1063275284 None] attachment_update completed successfully. Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Flow 'volume_create_manager' (ebdab1f4-a9b5-4b73-829f-bb636c281036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7316d3-60ca-43b4-9678-ed38b139918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7316d3-60ca-43b4-9678-ed38b139918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-681997675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7eec87-b50a-45b0-bd35-b9627e2874d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb8cb94243a484dbf78b866e9375ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:19Z,use_quota=True,user_id='7d6f27c7d96849aa9f76d666917bcaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17891ddc-1cb0-4cab-a592-fed8716ef4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17891ddc-1cb0-4cab-a592-fed8716ef4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71595e84-d7a9-4c93-a304-cd3df8d23e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71595e84-d7a9-4c93-a304-cd3df8d23e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7eec87-b50a-45b0-bd35-b9627e2874d4', 'volume_name': 'volume-db7eec87-b50a-45b0-bd35-b9627e2874d4', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdde58eb-5487-4add-9629-65713337369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdde58eb-5487-4add-9629-65713337369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39650de-fe69-44c3-87ac-da939c47270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Volume db7eec87-b50a-45b0-bd35-b9627e2874d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7eec87-b50a-45b0-bd35-b9627e2874d4', 'volume_size': 2} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-681997675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7eec87-b50a-45b0-bd35-b9627e2874d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb8cb94243a484dbf78b866e9375ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:19Z,use_quota=True,user_id='7d6f27c7d96849aa9f76d666917bcaef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Creating volume db7eec87-b50a-45b0-bd35-b9627e2874d4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:09:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 2147483648 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:18 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 2147483648 Nov 03 13:09:18 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:19 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 2147483648" returned: 0 in 0.445s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:19 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 Nov 03 13:09:19 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:19 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4" returned: 0 in 0.245s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39650de-fe69-44c3-87ac-da939c47270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7eec87-b50a-45b0-bd35-b9627e2874d4', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6fe811-4881-457c-b9c3-5e23db442c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Volume volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 (db7eec87-b50a-45b0-bd35-b9627e2874d4): created successfully Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6fe811-4881-457c-b9c3-5e23db442c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Flow 'volume_create_manager' (ebdab1f4-a9b5-4b73-829f-bb636c281036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1a5ab939-78cc-4275-84f8-2fa215161cde tempest-VolumesCloneNegativeTest-516408265 None] Created volume successfully. Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Acquiring lock "cinder-db7eec87-b50a-45b0-bd35-b9627e2874d4-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Lock "cinder-db7eec87-b50a-45b0-bd35-b9627e2874d4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Acquiring lock "cinder-quobyte-db7eec87-b50a-45b0-bd35-b9627e2874d4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Lock "cinder-quobyte-db7eec87-b50a-45b0-bd35-b9627e2874d4" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8892179b-995e-4f96-8e21-f5d8ccf7d886]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:19 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 Nov 03 13:09:19 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:20 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4" returned: 0 in 0.392s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:20 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4 Nov 03 13:09:20 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:20 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-db7eec87-b50a-45b0-bd35-b9627e2874d4" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Lock "cinder-quobyte-db7eec87-b50a-45b0-bd35-b9627e2874d4" released by "delete_volume" :: held 0.688s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Created reservations ['88aea3d6-1bea-4399-9702-7e5bbb653f8b', '11871e0b-d869-4471-949b-a277ffdd16c0', '15a07a59-c913-4fb3-8880-ae8f3e1455d6', '8f3db518-8e4b-4977-9b64-682a047218f4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:20 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:20 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:20 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Deleted volume successfully. Nov 03 13:09:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dfb569d8-115d-405f-9dab-696634760217 tempest-VolumesCloneNegativeTest-516408265 None] Lock "cinder-db7eec87-b50a-45b0-bd35-b9627e2874d4-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-11bbc7e6-a24b-4511-b4ba-323b0877d84b req-fa1765a6-c8c9-4255-8b00-319bb02f48cc tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-11bbc7e6-a24b-4511-b4ba-323b0877d84b req-fa1765a6-c8c9-4255-8b00-319bb02f48cc tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-11bbc7e6-a24b-4511-b4ba-323b0877d84b req-fa1765a6-c8c9-4255-8b00-319bb02f48cc tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-11bbc7e6-a24b-4511-b4ba-323b0877d84b req-fa1765a6-c8c9-4255-8b00-319bb02f48cc tempest-TestServerVolumeAttachmentScenario-1063275284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '135199b2-ee80-4f09-89e6-790300f03940', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:09:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-11bbc7e6-a24b-4511-b4ba-323b0877d84b req-fa1765a6-c8c9-4255-8b00-319bb02f48cc tempest-TestServerVolumeAttachmentScenario-1063275284 None] attachment_update completed successfully. Nov 03 13:09:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-50839d78-640b-4631-95b3-dd0070aa5d27 req-415dd75a-eaad-4adf-8313-a16be61181f7 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Terminate volume connection completed successfully. Nov 03 13:09:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-50839d78-640b-4631-95b3-dd0070aa5d27 req-415dd75a-eaad-4adf-8313-a16be61181f7 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Deleting attachment 135199b2-ee80-4f09-89e6-790300f03940. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:09:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Flow 'volume_create_manager' (9f4baef5-eb00-4af2-a97c-8ff6f4fd1b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398691be-5ea1-42a1-8c01-ffb886097406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398691be-5ea1-42a1-8c01-ffb886097406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1164567820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57affd92-1000-4d29-8a88-d7a1f40e96c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a627eedda7ed45c9822203fefddfa089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:25Z,use_quota=True,user_id='2eeb0e54acfd472f82019c8cd9075a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3827a270-7ce5-4928-ad61-bf3413d22654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3827a270-7ce5-4928-ad61-bf3413d22654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946224da-474a-46f5-8c8f-103542759a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946224da-474a-46f5-8c8f-103542759a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57affd92-1000-4d29-8a88-d7a1f40e96c9', 'volume_name': 'volume-57affd92-1000-4d29-8a88-d7a1f40e96c9', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c562bb1-64af-44aa-b576-094a2fe9971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c562bb1-64af-44aa-b576-094a2fe9971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e38c16e-6ecd-4553-a409-8198f1a913b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Volume 57affd92-1000-4d29-8a88-d7a1f40e96c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57affd92-1000-4d29-8a88-d7a1f40e96c9', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Trying to clone 57affd92-1000-4d29-8a88-d7a1f40e96c9 from image 68321eb5-d635-47b3-850b-90ed52040d26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:09:25 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19992c4-2849-4a31-b5af-f63b68d27772]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:25 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD Nov 03 13:09:25 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:26 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 is fetched for user 2eeb0e54acfd472f82019c8cd9075a72. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:09:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-ed541dae-445c-4255-9997-a5d12218c5ce req-11da57d3-64c9-4068-b46c-d8b0c5e15bf6 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Terminate volume connection completed successfully. Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ed541dae-445c-4255-9997-a5d12218c5ce req-11da57d3-64c9-4068-b46c-d8b0c5e15bf6 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Deleting attachment e4f7a16d-0786-4b0a-bf25-45fd3db9c93d. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e6719-d544-4fec-bac7-bfe6f28ea96d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:26 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD Nov 03 13:09:26 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:26 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1164567820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57affd92-1000-4d29-8a88-d7a1f40e96c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a627eedda7ed45c9822203fefddfa089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:25Z,use_quota=True,user_id='2eeb0e54acfd472f82019c8cd9075a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Creating volume 57affd92-1000-4d29-8a88-d7a1f40e96c9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:26 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:26 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 1073741824 Nov 03 13:09:26 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:26 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 1073741824" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:26 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 Nov 03 13:09:26 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:27 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Attempting download of 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 57affd92-1000-4d29-8a88-d7a1f40e96c9. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8327e174-4370-464b-9777-74fb4c9bd876]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_ihpv6lfw {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:27 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_ihpv6lfw Nov 03 13:09:27 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:27 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_ihpv6lfw" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_ihpv6lfw {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:27 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_ihpv6lfw Nov 03 13:09:27 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:28 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_ihpv6lfw" returned: 1 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_ihpv6lfw' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:09:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd5f502-2a7c-46db-bed9-3de720dfdc2e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:28 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD Nov 03 13:09:28 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:28 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:28 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] 68321eb5-d635-47b3-850b-90ed52040d26 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:09:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:28 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 Nov 03 13:09:28 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:30 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9" returned: 0 in 2.005s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_79ijt_uqdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:09:30 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Converted 112.00 MB image at 55.82 MB/s Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:30 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 1G Nov 03 13:09:30 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "cinder-7a9e89d1-7dd3-439e-9dc3-619be34be29f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-7a9e89d1-7dd3-439e-9dc3-619be34be29f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "cinder-quobyte-7a9e89d1-7dd3-439e-9dc3-619be34be29f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-quobyte-7a9e89d1-7dd3-439e-9dc3-619be34be29f" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f5e7c9-f1ac-4ae3-a226-b189fb7402d5]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:30 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 1G" returned: 0 in 0.345s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Downloaded image 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 57affd92-1000-4d29-8a88-d7a1f40e96c9 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 for user 2eeb0e54acfd472f82019c8cd9075a72 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Marking volume 57affd92-1000-4d29-8a88-d7a1f40e96c9 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Copying metadata from image 68321eb5-d635-47b3-850b-90ed52040d26 to 57affd92-1000-4d29-8a88-d7a1f40e96c9. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Creating volume glance metadata for volume 57affd92-1000-4d29-8a88-d7a1f40e96c9 backed by image 68321eb5-d635-47b3-850b-90ed52040d26 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:09:30 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f Nov 03 13:09:30 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e38c16e-6ecd-4553-a409-8198f1a913b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57affd92-1000-4d29-8a88-d7a1f40e96c9', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91210593-8e49-45bb-ae5a-6b06c7920f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Volume volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 (57affd92-1000-4d29-8a88-d7a1f40e96c9): created successfully Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91210593-8e49-45bb-ae5a-6b06c7920f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Flow 'volume_create_manager' (9f4baef5-eb00-4af2-a97c-8ff6f4fd1b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5d406aaf-5c68-4931-9f6c-3fb89b8ab994 tempest-VolumesExtendTest-107475691 None] Created volume successfully. Nov 03 13:09:31 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f" returned: 0 in 0.361s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:31 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f Nov 03 13:09:31 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:31 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7a9e89d1-7dd3-439e-9dc3-619be34be29f" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-quobyte-7a9e89d1-7dd3-439e-9dc3-619be34be29f" released by "delete_volume" :: held 0.661s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Created reservations ['7ec26cd2-f387-40cb-89c0-17772fb4489b', 'a6bff98e-394e-4132-bc46-b58e0a322278', '4ccb7804-42e8-4623-8333-521a8b5149d4', '28cde382-d476-4358-82dd-660745db723b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9826f307-7e6b-4406-bb0b-b4ac8e398a37]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:31 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:31 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 Nov 03 13:09:31 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:31 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:31 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "cinder-e4ceab7a-10e1-4f81-91e9-15644ec9aea9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Deleted volume successfully. Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-e4ceab7a-10e1-4f81-91e9-15644ec9aea9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:31 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 2G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b014ba48-bbeb-451d-99f9-48a1e0c24050 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-7a9e89d1-7dd3-439e-9dc3-619be34be29f-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "cinder-quobyte-e4ceab7a-10e1-4f81-91e9-15644ec9aea9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-quobyte-e4ceab7a-10e1-4f81-91e9-15644ec9aea9" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f73af-483e-4eb2-9e35-7f287f44230d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 2G" returned: 0 in 0.117s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.557s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5380f1c6-a1fc-48b7-98aa-18e17a8dad32 tempest-VolumesExtendTest-107475691 None] Extend volume completed successfully. Nov 03 13:09:32 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 Nov 03 13:09:32 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:32 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9" returned: 0 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:32 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9 Nov 03 13:09:32 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:32 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e4ceab7a-10e1-4f81-91e9-15644ec9aea9" returned: 0 in 0.246s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-quobyte-e4ceab7a-10e1-4f81-91e9-15644ec9aea9" released by "delete_volume" :: held 0.653s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Created reservations ['0e9b7afd-6803-4ee0-a597-f92e55157ec1', '07c96cdb-4282-43d9-94e7-989c45d9b8c5', 'd65d3eb1-a4da-4c75-8d23-e5370b886b34', '9c3012af-d3bc-45f0-b9d1-7f4cd287e9f9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:32 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:32 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Acquiring lock "cinder-57affd92-1000-4d29-8a88-d7a1f40e96c9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Lock "cinder-57affd92-1000-4d29-8a88-d7a1f40e96c9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Acquiring lock "cinder-quobyte-57affd92-1000-4d29-8a88-d7a1f40e96c9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:33 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-57affd92-1000-4d29-8a88-d7a1f40e96c9" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Deleted volume successfully. Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[70db8ff9-8e67-4acf-af73-db3e45966b3d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f14793d4-cdcf-4889-9c6d-f03d2bfc41b8 tempest-TestServerVolumeAttachmentScenario-1063275284 None] Lock "cinder-e4ceab7a-10e1-4f81-91e9-15644ec9aea9-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:33 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 Nov 03 13:09:33 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:33 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9" returned: 0 in 0.367s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:33 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9 Nov 03 13:09:33 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:33 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-57affd92-1000-4d29-8a88-d7a1f40e96c9" returned: 0 in 0.281s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-57affd92-1000-4d29-8a88-d7a1f40e96c9" released by "delete_volume" :: held 0.712s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Created reservations ['20277d00-f3f5-4fac-a63a-45e7969055ee', 'aa639e1c-d2e2-4110-99dd-920ec4d4e57d', 'bd3b1c60-e40b-42a4-bc9d-f6a463fc7295', 'ff604168-5e59-4624-9ca4-83a1705bf585'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:33 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:33 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:34 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Deleted volume successfully. Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4a649b29-7c27-41fd-b99e-62f71d2363bb tempest-VolumesExtendTest-107475691 None] Lock "cinder-57affd92-1000-4d29-8a88-d7a1f40e96c9-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Flow 'volume_create_manager' (ea2c137e-048b-4ac7-b99a-6f3df1009b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ac3ed1-ef51-4d09-bee7-81b9fb70b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ac3ed1-ef51-4d09-bee7-81b9fb70b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1493363534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccacf780-4feb-47f6-8fe5-3965c2ec528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a627eedda7ed45c9822203fefddfa089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:35Z,use_quota=True,user_id='2eeb0e54acfd472f82019c8cd9075a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937b7e61-2ef5-4dce-9062-ce5dd388b996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937b7e61-2ef5-4dce-9062-ce5dd388b996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d46f96-e59a-4109-932e-d2de7b0abf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d46f96-e59a-4109-932e-d2de7b0abf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccacf780-4feb-47f6-8fe5-3965c2ec528e', 'volume_name': 'volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d25f0ae-c6a6-4c23-8f9f-d09021469989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d25f0ae-c6a6-4c23-8f9f-d09021469989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2dddcc-b9ad-4ae5-8ac6-dee34ac3d8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Volume ccacf780-4feb-47f6-8fe5-3965c2ec528e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e', 'volume_size': 1} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1493363534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccacf780-4feb-47f6-8fe5-3965c2ec528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a627eedda7ed45c9822203fefddfa089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:35Z,use_quota=True,user_id='2eeb0e54acfd472f82019c8cd9075a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Creating volume ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:09:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:34 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e 1073741824 Nov 03 13:09:34 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:35 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e 1073741824" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:35 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e Nov 03 13:09:35 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:35 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2dddcc-b9ad-4ae5-8ac6-dee34ac3d8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1e3cd9-e4ef-4546-8db2-26a145e5bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Volume volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e (ccacf780-4feb-47f6-8fe5-3965c2ec528e): created successfully Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1e3cd9-e4ef-4546-8db2-26a145e5bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Flow 'volume_create_manager' (ea2c137e-048b-4ac7-b99a-6f3df1009b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6625e71b-a62f-41b4-8109-7d9b35568c57 tempest-VolumesExtendTest-107475691 None] Created volume successfully. Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Creating offline snapshot 9e53404e-ca53-4d3f-a85d-16d4e0fbab7d of volume ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b50b9-1d97-43ed-bc48-98f9d37aba41]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:35 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e Nov 03 13:09:35 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:36 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:36 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d 1G Nov 03 13:09:36 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:36 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d 1G" returned: 0 in 0.488s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:36 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d Nov 03 13:09:36 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:36 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:36 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d is being set with open permissions: ugo+rw Nov 03 13:09:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:37 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d Nov 03 13:09:37 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:37 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:37 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.info Nov 03 13:09:37 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:37 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.info" returned: 0 in 0.261s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:37 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.info is being set with open permissions: ugo+rw Nov 03 13:09:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:37 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.info Nov 03 13:09:37 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:37 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.info" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2cd344bc-543e-4611-8337-aadf325eacb5 tempest-VolumesExtendTest-107475691 None] Create snapshot completed successfully Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fae498-54e2-4252-aff3-70e71f79e657]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:39 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e Nov 03 13:09:39 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:39 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e" returned: 0 in 0.374s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d 2G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d 2G" returned: 0 in 0.151s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.572s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9aae61ad-298e-49a1-827e-5faa8c014719 tempest-VolumesExtendTest-107475691 None] Extend volume completed successfully. Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Acquiring lock "cinder-9e53404e-ca53-4d3f-a85d-16d4e0fbab7d-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Lock "cinder-9e53404e-ca53-4d3f-a85d-16d4e0fbab7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Acquiring lock "cinder-quobyte-ccacf780-4feb-47f6-8fe5-3965c2ec528e" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-ccacf780-4feb-47f6-8fe5-3965c2ec528e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Acquiring lock "cinder-quobyte-9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Deleting offline snapshot 9e53404e-ca53-4d3f-a85d-16d4e0fbab7d of volume ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] snapshot_file for this snap is: volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5e320-9fd0-4d9d-b95f-f7645b38b6c2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:40 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d Nov 03 13:09:40 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:40 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[94159885-c1cb-4f3c-85d4-e07b47ada6a3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:40 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e Nov 03 13:09:40 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:41 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e" returned: 0 in 0.404s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:41 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d Nov 03 13:09:41 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:41 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:41 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d Nov 03 13:09:41 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:41 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e.9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-9e53404e-ca53-4d3f-a85d-16d4e0fbab7d" released by "_delete_snapshot" :: held 1.676s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-ccacf780-4feb-47f6-8fe5-3965c2ec528e" released by "delete_snapshot" :: held 1.707s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Created reservations ['91867c37-3df2-4618-88f4-6158c845a870', '4d352fcd-f5fd-4d2e-8c9e-b51b408ff601', 'b41be497-ea5b-4f8f-9c4d-95fe27093789', 'c7b0a03b-2d17-4f7e-8bee-ef99e2619e8a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Delete snapshot completed successfully. Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-43fd5e0b-73ed-4f49-b99f-f485baa103dd tempest-VolumesExtendTest-107475691 None] Lock "cinder-9e53404e-ca53-4d3f-a85d-16d4e0fbab7d-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Acquiring lock "cinder-ccacf780-4feb-47f6-8fe5-3965c2ec528e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Lock "cinder-ccacf780-4feb-47f6-8fe5-3965c2ec528e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Acquiring lock "cinder-quobyte-ccacf780-4feb-47f6-8fe5-3965c2ec528e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-ccacf780-4feb-47f6-8fe5-3965c2ec528e" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[46184561-59da-41e7-b27a-3d7ce3d01086]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:42 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e Nov 03 13:09:42 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:43 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:43 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e Nov 03 13:09:43 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:43 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ccacf780-4feb-47f6-8fe5-3965c2ec528e" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Lock "cinder-quobyte-ccacf780-4feb-47f6-8fe5-3965c2ec528e" released by "delete_volume" :: held 0.735s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Created reservations ['01b8c178-c635-47d0-86d9-725736921c3a', '88dd9fae-bfcc-4c25-8085-b7f3e21b1415', '1b8afdb6-6421-4501-8f9f-696f5a310a4e', '76187a50-3c81-4a8c-8ee3-475169d6fba5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:43 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:43 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:43 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Deleted volume successfully. Nov 03 13:09:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7886c9f-a968-48bb-b84b-17c17140b653 tempest-VolumesExtendTest-107475691 None] Lock "cinder-ccacf780-4feb-47f6-8fe5-3965c2ec528e-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (6d947507-481e-4b45-8a31-53903dac1ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183d1cbf-7cb2-48ba-9cac-5900a00231e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183d1cbf-7cb2-48ba-9cac-5900a00231e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-865173937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c09ad87-3b5a-4dee-a83a-e77a215174cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:48Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35cfd67-c7b9-43f1-b82d-886d8356c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35cfd67-c7b9-43f1-b82d-886d8356c23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12199ce-36fe-444a-8a78-0e13a7749ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12199ce-36fe-444a-8a78-0e13a7749ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c09ad87-3b5a-4dee-a83a-e77a215174cb', 'volume_name': 'volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de440cb6-b6cc-4737-81d6-90ca956600b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de440cb6-b6cc-4737-81d6-90ca956600b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8836a362-f4d2-4a00-ab97-78c970f08796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Volume 9c09ad87-3b5a-4dee-a83a-e77a215174cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb', 'volume_size': 1} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-865173937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c09ad87-3b5a-4dee-a83a-e77a215174cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:48Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Creating volume 9c09ad87-3b5a-4dee-a83a-e77a215174cb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:47 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:09:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:47 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb 1073741824 Nov 03 13:09:47 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:48 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb 1073741824" returned: 0 in 0.438s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:48 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb Nov 03 13:09:48 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:48 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8836a362-f4d2-4a00-ab97-78c970f08796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707ccf8f-6a48-4aed-b507-d94c70285391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Volume volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb (9c09ad87-3b5a-4dee-a83a-e77a215174cb): created successfully Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707ccf8f-6a48-4aed-b507-d94c70285391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (6d947507-481e-4b45-8a31-53903dac1ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0348ccca-fc9c-4a8c-9f12-e69a6d9f2fff tempest-VolumesGetTest-2012839379 None] Created volume successfully. Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (27e01bac-b242-4026-aa95-00ee1471cc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28f19f8-bf62-4ea8-a08e-68adec71d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28f19f8-bf62-4ea8-a08e-68adec71d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897310868',display_name='tempest-VolumesGetTest-Volume-1564107538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad45f983-2ada-4b99-baf0-a3ffe083f7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:49Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9e5f90-b6ad-480e-b37c-21d230cf3c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9e5f90-b6ad-480e-b37c-21d230cf3c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab3d04f-011f-4cab-b563-43b016af8ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab3d04f-011f-4cab-b563-43b016af8ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad45f983-2ada-4b99-baf0-a3ffe083f7ee', 'volume_name': 'volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d532e54-eaf3-40b5-86e5-25977834d297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d532e54-eaf3-40b5-86e5-25977834d297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ee91dc-c211-4d9f-9098-a9d64984dd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Volume ad45f983-2ada-4b99-baf0-a3ffe083f7ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee', 'volume_size': 1} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897310868',display_name='tempest-VolumesGetTest-Volume-1564107538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad45f983-2ada-4b99-baf0-a3ffe083f7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:49Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Creating volume ad45f983-2ada-4b99-baf0-a3ffe083f7ee {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:49 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:09:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:49 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee 1073741824 Nov 03 13:09:49 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:50 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee 1073741824" returned: 0 in 0.489s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:50 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee Nov 03 13:09:50 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:50 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ee91dc-c211-4d9f-9098-a9d64984dd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5a04c7-5d21-4578-a00d-863cbae23c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Volume volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee (ad45f983-2ada-4b99-baf0-a3ffe083f7ee): created successfully Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5a04c7-5d21-4578-a00d-863cbae23c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (27e01bac-b242-4026-aa95-00ee1471cc25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-212aeb00-6b36-4746-b8dc-839b89fe9033 tempest-VolumesGetTest-2012839379 None] Created volume successfully. Nov 03 13:09:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-ad45f983-2ada-4b99-baf0-a3ffe083f7ee-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Lock "cinder-ad45f983-2ada-4b99-baf0-a3ffe083f7ee-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-ad45f983-2ada-4b99-baf0-a3ffe083f7ee" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-ad45f983-2ada-4b99-baf0-a3ffe083f7ee" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c51342f-91a2-4d17-a2e9-39c0cd3c0af8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:51 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee Nov 03 13:09:51 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:52 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee" returned: 0 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:52 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee Nov 03 13:09:52 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:52 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ad45f983-2ada-4b99-baf0-a3ffe083f7ee" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-ad45f983-2ada-4b99-baf0-a3ffe083f7ee" released by "delete_volume" :: held 0.729s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Created reservations ['1ca4d899-b976-4e95-99d7-7acbe34683af', 'f1395d04-ecff-48a0-9c74-f8008d7fcfba', '31fd63de-7cb0-4138-86ea-216dfa11fe11', 'e44b668a-5459-4220-8983-9409680cd150'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:52 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:52 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:52 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-9c09ad87-3b5a-4dee-a83a-e77a215174cb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Lock "cinder-9c09ad87-3b5a-4dee-a83a-e77a215174cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Deleted volume successfully. Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e6f83ee3-3772-46a9-a287-3ed273312e50 tempest-VolumesGetTest-2012839379 None] Lock "cinder-ad45f983-2ada-4b99-baf0-a3ffe083f7ee-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-9c09ad87-3b5a-4dee-a83a-e77a215174cb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-9c09ad87-3b5a-4dee-a83a-e77a215174cb" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faf9d21-8e76-406e-bf0a-cd2b6526959a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:53 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb Nov 03 13:09:53 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:53 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:53 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb Nov 03 13:09:53 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:53 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-9c09ad87-3b5a-4dee-a83a-e77a215174cb" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-9c09ad87-3b5a-4dee-a83a-e77a215174cb" released by "delete_volume" :: held 0.732s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Created reservations ['432ce2ab-032d-49d4-8747-0184d2afe3b9', 'ce80c988-9fd0-4ec2-a9d1-defb62275989', '97f0ab03-2693-443f-9a6e-3dff29da3761', 'afba1506-9fb2-49a4-b9c2-8ad7b86029d0'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:09:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:54 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:54 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:54 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Deleted volume successfully. Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bd5638a0-8b88-4140-b3a9-c0c8289399d6 tempest-VolumesGetTest-2012839379 None] Lock "cinder-9c09ad87-3b5a-4dee-a83a-e77a215174cb-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (f5eb4569-6867-4700-b780-ecd4bd242ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d216c4d-a163-4543-b353-602d921f4f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d216c4d-a163-4543-b353-602d921f4f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1069487520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d86f94-6393-4a62-94da-0c91cf73ef42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:55Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ec7703-319b-413f-bed3-a71afc70dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ec7703-319b-413f-bed3-a71afc70dc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed2369-d0fe-46da-8d2b-d0bc6a33a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed2369-d0fe-46da-8d2b-d0bc6a33a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d86f94-6393-4a62-94da-0c91cf73ef42', 'volume_name': 'volume-c2d86f94-6393-4a62-94da-0c91cf73ef42', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2beaa105-c18e-4906-b769-5c22797ab110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2beaa105-c18e-4906-b769-5c22797ab110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75178e24-2172-4859-af6d-22bd9d18b90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Volume c2d86f94-6393-4a62-94da-0c91cf73ef42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d86f94-6393-4a62-94da-0c91cf73ef42', 'volume_size': 1} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1069487520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d86f94-6393-4a62-94da-0c91cf73ef42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:55Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Creating volume c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:09:54 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:09:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:54 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 1073741824 Nov 03 13:09:54 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:55 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 1073741824" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=90,cinder:UPDATE=96,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=92,cinder:UPDATE=110,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:55 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 Nov 03 13:09:55 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:55 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75178e24-2172-4859-af6d-22bd9d18b90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d86f94-6393-4a62-94da-0c91cf73ef42', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380e1592-f04b-45d0-abe6-9257c2e53d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Volume volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 (c2d86f94-6393-4a62-94da-0c91cf73ef42): created successfully Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380e1592-f04b-45d0-abe6-9257c2e53d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (f5eb4569-6867-4700-b780-ecd4bd242ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b9ed2326-8d13-4cbc-ad7b-31bd05ce1c7f tempest-VolumesGetTest-2012839379 None] Created volume successfully. Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (42537b4b-11b0-45b3-b67f-447ce342171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4c9dc-0fa6-4523-8006-5ba1b6ffd9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa4c9dc-0fa6-4523-8006-5ba1b6ffd9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-619650358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c2d86f94-6393-4a62-94da-0c91cf73ef42,status='creating',terminated_at=None,updated_at=2026-11-03T12:09:57Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd02b23e-3597-40ac-a425-ad41828135fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd02b23e-3597-40ac-a425-ad41828135fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d06a7f-9acf-4366-8a71-7a1677bc4e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d06a7f-9acf-4366-8a71-7a1677bc4e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e', 'volume_name': 'volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e', 'volume_size': 1, 'source_volid': 'c2d86f94-6393-4a62-94da-0c91cf73ef42', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aba4fbb-34cd-4c55-b065-6d0fc960ce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aba4fbb-34cd-4c55-b065-6d0fc960ce0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da156c18-6960-4348-87e6-1c56b08c7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:09:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Volume dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e', 'volume_size': 1, 'source_volid': 'c2d86f94-6393-4a62-94da-0c91cf73ef42', 'source_volstatus': 'available'} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:57 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Cloning volume c2d86f94-6393-4a62-94da-0c91cf73ef42 to volume dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Creating offline snapshot 778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 of volume c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc85b71-b975-443d-a1d0-8c6b2476aaba]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:57 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 Nov 03 13:09:57 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:58 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42" returned: 0 in 0.403s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:58 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 1G Nov 03 13:09:58 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:58 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 1G" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:58 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 Nov 03 13:09:58 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:58 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:09:58 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:58 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:58 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 is being set with open permissions: ugo+rw Nov 03 13:09:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:58 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 Nov 03 13:09:58 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:59 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:09:59 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" returned: 0 in 0.387s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:59 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.info Nov 03 13:09:59 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:59 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.info" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:59 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.info is being set with open permissions: ugo+rw Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:59 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.info Nov 03 13:09:59 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:09:59 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.info" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] snapshot: 778df1de-4075-4e5d-9cc1-e1d8c7cec8b0, volume: dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adbfa5e-18be-4cb0-b030-f0c94806ccba]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:09:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:09:59 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 Nov 03 13:09:59 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:00 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" returned: 0 in 0.412s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d86f94-6393-4a62-94da-0c91cf73ef42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6bea40-3157-4a02-9916-ec27841345a6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:00 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 Nov 03 13:10:00 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:00 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:10:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:00 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e Nov 03 13:10:00 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:08 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" returned: 0 in 7.426s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:10:08 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Converted 1024.00 MB image at 137.87 MB/s Nov 03 13:10:08 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e is being set with open permissions: ugo+rw Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:08 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e Nov 03 13:10:08 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:08 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" released by "_copy_volume_from_snapshot" :: held 8.608s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Deleting offline snapshot 778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 of volume c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] snapshot_file for this snap is: volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bc2ca-f373-472c-80c9-6135b185f450]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:08 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 Nov 03 13:10:08 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:08 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d86f94-6393-4a62-94da-0c91cf73ef42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da3822-d405-4f5a-a629-b115eb01aa4c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:09 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 Nov 03 13:10:09 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5,cinder:INSERT=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:10:09 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42" returned: 0 in 0.583s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:09 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 Nov 03 13:10:09 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Flow 'volume_create_manager' (4e0161b1-828b-48f9-a9cd-cebf7e24da53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c7eb39-8bea-4241-80d9-4e95e1fc674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c7eb39-8bea-4241-80d9-4e95e1fc674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-569522724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c364a2e0-8141-4927-9828-944feb3b08d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b469c3a9714640ba41a791dc7e8f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:10Z,use_quota=True,user_id='1668559187494bb2aefbe339dd49cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db75526-c72d-4f91-811b-1cfed1645a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db75526-c72d-4f91-811b-1cfed1645a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ae71d6-b65f-46bd-b21a-18bb3c22352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ae71d6-b65f-46bd-b21a-18bb3c22352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c364a2e0-8141-4927-9828-944feb3b08d5', 'volume_name': 'volume-c364a2e0-8141-4927-9828-944feb3b08d5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c24d40-9f9c-4524-8c6f-b158d727a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c24d40-9f9c-4524-8c6f-b158d727a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84acaee-0f9b-470f-9536-cc5f454844cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Volume c364a2e0-8141-4927-9828-944feb3b08d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c364a2e0-8141-4927-9828-944feb3b08d5', 'volume_size': 1} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:09 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:09 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0 Nov 03 13:10:09 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:10 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42.778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-778df1de-4075-4e5d-9cc1-e1d8c7cec8b0" released by "_delete_snapshot" :: held 1.710s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.560s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-569522724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c364a2e0-8141-4927-9828-944feb3b08d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b469c3a9714640ba41a791dc7e8f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:10Z,use_quota=True,user_id='1668559187494bb2aefbe339dd49cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Creating volume c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:10 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:10 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 1073741824 Nov 03 13:10:10 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da156c18-6960-4348-87e6-1c56b08c7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e', 'volume_size': 1, 'source_volid': 'c2d86f94-6393-4a62-94da-0c91cf73ef42', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c4b7ed-992b-47a6-ad2a-7e7c6b11d4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Volume volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e (dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e): created successfully Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c4b7ed-992b-47a6-ad2a-7e7c6b11d4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (42537b4b-11b0-45b3-b67f-447ce342171c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e51de8d5-b611-44cd-b77d-5eb4e2de9598 tempest-VolumesGetTest-2012839379 None] Created volume successfully. Nov 03 13:10:10 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 1073741824" returned: 0 in 0.537s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:10 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 Nov 03 13:10:10 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:11 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5" returned: 0 in 0.281s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84acaee-0f9b-470f-9536-cc5f454844cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c364a2e0-8141-4927-9828-944feb3b08d5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7435ba-59dd-4160-8db3-eb4985d9e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Volume volume-c364a2e0-8141-4927-9828-944feb3b08d5 (c364a2e0-8141-4927-9828-944feb3b08d5): created successfully Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7435ba-59dd-4160-8db3-eb4985d9e876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Flow 'volume_create_manager' (4e0161b1-828b-48f9-a9cd-cebf7e24da53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-846e6747-3361-49fa-88df-702716de20b3 tempest-TestStampPattern-2074965951 None] Created volume successfully. Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (d44322e3-2748-4e2a-9e7c-20524ea22b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c475c15-f4dc-4615-b8d7-0fee50c7977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c475c15-f4dc-4615-b8d7-0fee50c7977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-193626223',display_name='tempest-VolumesGetTest-Volume-1584250422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375dc1d9-eed1-4ca8-af82-c2449e779a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:11Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a1b5a2-d588-485f-98f4-56a454789d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a1b5a2-d588-485f-98f4-56a454789d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7762208f-72cb-480f-b402-c72d826bafd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7762208f-72cb-480f-b402-c72d826bafd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375dc1d9-eed1-4ca8-af82-c2449e779a96', 'volume_name': 'volume-375dc1d9-eed1-4ca8-af82-c2449e779a96', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cabbe5b-8b7a-470f-b382-a5336d29c618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cabbe5b-8b7a-470f-b382-a5336d29c618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86dfdc74-e276-4557-9126-2b960a264b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Volume 375dc1d9-eed1-4ca8-af82-c2449e779a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375dc1d9-eed1-4ca8-af82-c2449e779a96', 'volume_size': 1} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-193626223',display_name='tempest-VolumesGetTest-Volume-1584250422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375dc1d9-eed1-4ca8-af82-c2449e779a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:11Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Creating volume 375dc1d9-eed1-4ca8-af82-c2449e779a96 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:11 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:10:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:11 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 1073741824 Nov 03 13:10:11 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:11 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 1073741824" returned: 0 in 0.495s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:12 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 Nov 03 13:10:12 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:12 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86dfdc74-e276-4557-9126-2b960a264b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375dc1d9-eed1-4ca8-af82-c2449e779a96', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167f704e-bbd1-48e8-888d-6d5612ea9cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Volume volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 (375dc1d9-eed1-4ca8-af82-c2449e779a96): created successfully Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167f704e-bbd1-48e8-888d-6d5612ea9cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (d44322e3-2748-4e2a-9e7c-20524ea22b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-87d64014-eb5d-4676-856c-8ed6f3d370ba tempest-VolumesGetTest-2012839379 None] Created volume successfully. Nov 03 13:10:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-375dc1d9-eed1-4ca8-af82-c2449e779a96-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Lock "cinder-375dc1d9-eed1-4ca8-af82-c2449e779a96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-375dc1d9-eed1-4ca8-af82-c2449e779a96" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-375dc1d9-eed1-4ca8-af82-c2449e779a96" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abbf2a0-22df-455e-b5a7-1875a303ddd3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:13 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 Nov 03 13:10:13 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:14 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:14 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96 Nov 03 13:10:14 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:14 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-375dc1d9-eed1-4ca8-af82-c2449e779a96" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-375dc1d9-eed1-4ca8-af82-c2449e779a96" released by "delete_volume" :: held 0.712s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Created reservations ['7111aef5-c177-4dd8-8930-990d8d22be8a', '04724cb2-e3fb-4229-85a3-4c32143fca81', '9114e529-afd7-4023-bf50-6118c49e95d7', 'f780cf95-b540-414b-8375-be66349da78e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:14 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:10:14 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:14 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:14 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Deleted volume successfully. Nov 03 13:10:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4964c747-36fa-452c-9bcf-204686c5ac14 tempest-VolumesGetTest-2012839379 None] Lock "cinder-375dc1d9-eed1-4ca8-af82-c2449e779a96-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Lock "cinder-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe0b6c5-3577-462a-9912-9b55362cbb39]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:15 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e Nov 03 13:10:15 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:16 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" returned: 0 in 0.721s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:16 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e Nov 03 13:10:16 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:16 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e" released by "delete_volume" :: held 1.096s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Created reservations ['e092c21a-4645-413e-94e2-10fb058b97b6', '8cc2f1b3-ef21-4300-a0a6-1b80fa578a92', '45194a8e-e345-4d06-9dd6-8670ca07c89a', '7a5865df-5c98-4a80-909f-59e5ad2ab734'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:16 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:10:16 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:16 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Deleted volume successfully. Nov 03 13:10:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17ed9179-1194-4078-b603-8823f1c92b38 tempest-VolumesGetTest-2012839379 None] Lock "cinder-dff1f9de-4ee7-4f87-8b70-cb6993fbaa4e-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-c2d86f94-6393-4a62-94da-0c91cf73ef42-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Lock "cinder-c2d86f94-6393-4a62-94da-0c91cf73ef42-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-c2d86f94-6393-4a62-94da-0c91cf73ef42" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-c2d86f94-6393-4a62-94da-0c91cf73ef42" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d94195d-9fa3-4d7a-b2ed-699a7f6f7f6a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:17 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 Nov 03 13:10:17 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:17 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:18 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42 Nov 03 13:10:18 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:18 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c2d86f94-6393-4a62-94da-0c91cf73ef42" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-c2d86f94-6393-4a62-94da-0c91cf73ef42" released by "delete_volume" :: held 0.796s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Created reservations ['b4c3a904-cc43-4968-8dd0-24f6f1f3b315', 'efcd5030-b2ff-41c7-a2ee-168807b99e77', '18f6b3b3-ff28-4a18-9ab8-777554e29f83', '052b3ebc-f295-4845-b2b7-e51e6e1f42b5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:18 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:10:18 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:18 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.343s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Deleted volume successfully. Nov 03 13:10:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa220679-6ad4-4005-8a91-14849628a32e tempest-VolumesGetTest-2012839379 None] Lock "cinder-c2d86f94-6393-4a62-94da-0c91cf73ef42-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (14975fb9-90c5-4a2f-8398-deff223bbf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920be9f7-59b8-4f26-b120-c5076ea6dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920be9f7-59b8-4f26-b120-c5076ea6dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1095344490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f779ff5-171d-4ef6-81f5-586af7f570ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:19Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9f8fba-4eb7-479e-98c0-a48d19f8a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9f8fba-4eb7-479e-98c0-a48d19f8a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408cc0a3-d418-43a3-8d08-b0f88f0c95f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408cc0a3-d418-43a3-8d08-b0f88f0c95f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f779ff5-171d-4ef6-81f5-586af7f570ca', 'volume_name': 'volume-7f779ff5-171d-4ef6-81f5-586af7f570ca', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd90813-b922-4d54-9c46-cc696b9f7e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd90813-b922-4d54-9c46-cc696b9f7e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a103113-71e0-4f04-9b1a-61fb392e9ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Volume 7f779ff5-171d-4ef6-81f5-586af7f570ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f779ff5-171d-4ef6-81f5-586af7f570ca', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 13:10:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Trying to clone 7f779ff5-171d-4ef6-81f5-586af7f570ca from image 68321eb5-d635-47b3-850b-90ed52040d26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:10:20 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Image download 20.69 MB at 20.69 MB/s Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d774760d-e5a7-4991-bc00-b9ffdc697763]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:20 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD Nov 03 13:10:20 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:20 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 is fetched for user 7f2ae75e6a8a4a99ab158bdcfb700bbd. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafe97ba-037f-447e-b3ed-acf516bd9f8a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:20 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD Nov 03 13:10:20 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:20 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1095344490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f779ff5-171d-4ef6-81f5-586af7f570ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:19Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Creating volume 7f779ff5-171d-4ef6-81f5-586af7f570ca {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:21 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:21 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca 1073741824 Nov 03 13:10:21 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:21 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca 1073741824" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:21 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca Nov 03 13:10:21 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:21 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Attempting download of 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 7f779ff5-171d-4ef6-81f5-586af7f570ca. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca6cc8-0640-4621-a33f-7937bb6d9220]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_k7qkko1s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:21 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_k7qkko1s Nov 03 13:10:21 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:22 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_k7qkko1s" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_k7qkko1s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:22 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_k7qkko1s Nov 03 13:10:22 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:22 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_k7qkko1s" returned: 1 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68321eb5-d635-47b3-850b-90ed52040d26_k7qkko1s' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b735de6b-b5c7-4cf9-ba7e-e9397000450b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:22 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD Nov 03 13:10:22 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:22 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] 68321eb5-d635-47b3-850b-90ed52040d26 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:10:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:22 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca Nov 03 13:10:22 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:24 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca" returned: 0 in 1.827s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:24 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68321eb5-d635-47b3-850b-90ed52040d26_zvfspd3ldevstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:10:24 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Converted 112.00 MB image at 61.25 MB/s Nov 03 13:10:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:24 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca 1G Nov 03 13:10:24 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:25 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca 1G" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Downloaded image 68321eb5-d635-47b3-850b-90ed52040d26 ((None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}])) to volume 7f779ff5-171d-4ef6-81f5-586af7f570ca successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Temporary image 68321eb5-d635-47b3-850b-90ed52040d26 for user 7f2ae75e6a8a4a99ab158bdcfb700bbd is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Marking volume 7f779ff5-171d-4ef6-81f5-586af7f570ca as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Copying metadata from image 68321eb5-d635-47b3-850b-90ed52040d26 to 7f779ff5-171d-4ef6-81f5-586af7f570ca. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Creating volume glance metadata for volume 7f779ff5-171d-4ef6-81f5-586af7f570ca backed by image 68321eb5-d635-47b3-850b-90ed52040d26 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a103113-71e0-4f04-9b1a-61fb392e9ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f779ff5-171d-4ef6-81f5-586af7f570ca', 'volume_size': 1, 'image_id': '68321eb5-d635-47b3-850b-90ed52040d26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68321eb5-d635-47b3-850b-90ed52040d26', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd62eb3eeccc747d888db0844c7a87d29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68321eb5-d635-47b3-850b-90ed52040d26', 'created_at': datetime.datetime(2026, 11, 3, 11, 49, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 11, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68321eb5-d635-47b3-850b-90ed52040d26/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5f3406-9b8a-4d1e-9d16-160a52a700c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Volume volume-7f779ff5-171d-4ef6-81f5-586af7f570ca (7f779ff5-171d-4ef6-81f5-586af7f570ca): created successfully Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5f3406-9b8a-4d1e-9d16-160a52a700c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (14975fb9-90c5-4a2f-8398-deff223bbf0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5012c706-d66e-4bb9-a2ed-0601b9e34884 tempest-VolumesGetTest-2012839379 None] Created volume successfully. Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (f43af71a-ef4f-4961-aecc-2568a296d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c85ed1-8680-43bb-a94e-7dc28a393d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c85ed1-8680-43bb-a94e-7dc28a393d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249184378',display_name='tempest-VolumesGetTest-Volume-1069360393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9cbd8c-7737-4450-862b-bc97b1c962fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:27Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5a65f1-edae-4843-b54a-261990e7d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5a65f1-edae-4843-b54a-261990e7d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8732a9-8948-4a4e-9e74-a11b83e2cb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8732a9-8948-4a4e-9e74-a11b83e2cb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9cbd8c-7737-4450-862b-bc97b1c962fc', 'volume_name': 'volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634f579e-0e34-45c3-92b1-d0bf37e01084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634f579e-0e34-45c3-92b1-d0bf37e01084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e77a63-2d68-4342-a971-d55a177e7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Volume 2e9cbd8c-7737-4450-862b-bc97b1c962fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc', 'volume_size': 1} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249184378',display_name='tempest-VolumesGetTest-Volume-1069360393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9cbd8c-7737-4450-862b-bc97b1c962fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc655f71c7594605941c90b32564b853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:27Z,use_quota=True,user_id='7f2ae75e6a8a4a99ab158bdcfb700bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Creating volume 2e9cbd8c-7737-4450-862b-bc97b1c962fc {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:26 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:10:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:26 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc 1073741824 Nov 03 13:10:26 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:27 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc 1073741824" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:27 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc Nov 03 13:10:27 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:27 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e77a63-2d68-4342-a971-d55a177e7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ab780e-9309-4047-a905-d60318e380f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Volume volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc (2e9cbd8c-7737-4450-862b-bc97b1c962fc): created successfully Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ab780e-9309-4047-a905-d60318e380f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Flow 'volume_create_manager' (f43af71a-ef4f-4961-aecc-2568a296d23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bc4ea04a-2e61-440a-8d6a-1b7f4b90fbe9 tempest-VolumesGetTest-2012839379 None] Created volume successfully. Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-2e9cbd8c-7737-4450-862b-bc97b1c962fc-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Lock "cinder-2e9cbd8c-7737-4450-862b-bc97b1c962fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-2e9cbd8c-7737-4450-862b-bc97b1c962fc" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-2e9cbd8c-7737-4450-862b-bc97b1c962fc" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46902d-6ce0-426d-a8e1-0807f7f05c3c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:27 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc Nov 03 13:10:27 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:28 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:28 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc Nov 03 13:10:28 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:28 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2e9cbd8c-7737-4450-862b-bc97b1c962fc" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-2e9cbd8c-7737-4450-862b-bc97b1c962fc" released by "delete_volume" :: held 0.704s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Created reservations ['1f320963-c407-49a9-8cef-b9daa876f389', '28a75bfc-4ab1-44ea-a6bc-432ce512eba4', 'f17f4c57-2aa0-4000-8edc-5dd86dce83c9', '07ba4d67-adc4-43a5-9db1-070df4e50894'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:28 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:10:28 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:28 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Deleted volume successfully. Nov 03 13:10:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2a41e3dd-11ce-43a6-9808-1529b0d170e2 tempest-VolumesGetTest-2012839379 None] Lock "cinder-2e9cbd8c-7737-4450-862b-bc97b1c962fc-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-7f779ff5-171d-4ef6-81f5-586af7f570ca-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Lock "cinder-7f779ff5-171d-4ef6-81f5-586af7f570ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Acquiring lock "cinder-quobyte-7f779ff5-171d-4ef6-81f5-586af7f570ca" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-7f779ff5-171d-4ef6-81f5-586af7f570ca" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9b59f-7d87-402d-8921-3656d0955939]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:29 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca Nov 03 13:10:29 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:29 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca" returned: 0 in 0.375s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:29 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca Nov 03 13:10:29 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:29 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7f779ff5-171d-4ef6-81f5-586af7f570ca" returned: 0 in 0.245s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Lock "cinder-quobyte-7f779ff5-171d-4ef6-81f5-586af7f570ca" released by "delete_volume" :: held 0.662s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Created reservations ['db3de049-0447-46b9-9c63-8462bc60b146', 'eb75489d-a19a-42b3-920f-534d46943c73', '9c4ed384-eedd-45b7-8e86-9e6c3af794a1', 'e53297c9-72b0-4e45-99c6-23c08a86d332'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:29 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:10:29 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:30 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:30 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Deleted volume successfully. Nov 03 13:10:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37d0763d-7a17-4cef-b8c5-6ff307ca3618 tempest-VolumesGetTest-2012839379 None] Lock "cinder-7f779ff5-171d-4ef6-81f5-586af7f570ca-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Flow 'volume_create_manager' (44914b79-09e7-432f-831d-e1444944574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a155329b-7a66-4b95-93ab-84949e9f5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a155329b-7a66-4b95-93ab-84949e9f5c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-576987559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56c1a6a-d100-470e-ad63-8c2901a15756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784d5eeea5e464ab349aec657882a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:33Z,use_quota=True,user_id='b4b42a3f22c740f8876c4c96086c542e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425c2cb6-3349-47d8-8b34-0d92e3915847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425c2cb6-3349-47d8-8b34-0d92e3915847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bbeb5e-1941-4639-acb3-fb24271a529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bbeb5e-1941-4639-acb3-fb24271a529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56c1a6a-d100-470e-ad63-8c2901a15756', 'volume_name': 'volume-e56c1a6a-d100-470e-ad63-8c2901a15756', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac719a97-8f67-4aac-b909-2d5583689356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac719a97-8f67-4aac-b909-2d5583689356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fdc757-2ae0-4693-88df-37aef0f0c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Volume e56c1a6a-d100-470e-ad63-8c2901a15756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56c1a6a-d100-470e-ad63-8c2901a15756', 'volume_size': 1} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-576987559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56c1a6a-d100-470e-ad63-8c2901a15756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784d5eeea5e464ab349aec657882a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:33Z,use_quota=True,user_id='b4b42a3f22c740f8876c4c96086c542e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Creating volume e56c1a6a-d100-470e-ad63-8c2901a15756 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:33 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:10:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:33 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 1073741824 Nov 03 13:10:33 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:34 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 1073741824" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:34 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 Nov 03 13:10:34 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:34 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756" returned: 0 in 0.237s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fdc757-2ae0-4693-88df-37aef0f0c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56c1a6a-d100-470e-ad63-8c2901a15756', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a1ce43-abc4-4881-b259-7daa0d94256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Volume volume-e56c1a6a-d100-470e-ad63-8c2901a15756 (e56c1a6a-d100-470e-ad63-8c2901a15756): created successfully Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a1ce43-abc4-4881-b259-7daa0d94256f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Flow 'volume_create_manager' (44914b79-09e7-432f-831d-e1444944574b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3ed29fab-4af3-4d94-8f52-92e322c02e02 tempest-VolumesNegativeTest-483184791 None] Created volume successfully. Nov 03 13:10:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-d58e5623-8590-4e89-84b9-504d8faaeccb req-5b3db0d1-1bf3-4404-9e9e-8bc2d8a6af65 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-d58e5623-8590-4e89-84b9-504d8faaeccb req-5b3db0d1-1bf3-4404-9e9e-8bc2d8a6af65 tempest-TestStampPattern-2074965951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-d58e5623-8590-4e89-84b9-504d8faaeccb req-5b3db0d1-1bf3-4404-9e9e-8bc2d8a6af65 tempest-TestStampPattern-2074965951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-d58e5623-8590-4e89-84b9-504d8faaeccb req-5b3db0d1-1bf3-4404-9e9e-8bc2d8a6af65 tempest-TestStampPattern-2074965951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-c364a2e0-8141-4927-9828-944feb3b08d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8470bf84-4ccc-47bf-ab7e-6a839b06266c', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:10:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-d58e5623-8590-4e89-84b9-504d8faaeccb req-5b3db0d1-1bf3-4404-9e9e-8bc2d8a6af65 tempest-TestStampPattern-2074965951 None] attachment_update completed successfully. Nov 03 13:10:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-27cbcd6e-6a52-4088-b310-178ee8909817 req-cdbd7fa4-897b-4c33-90e7-700dac43b929 tempest-TestStampPattern-2074965951 None] Terminate volume connection completed successfully. Nov 03 13:10:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-27cbcd6e-6a52-4088-b310-178ee8909817 req-cdbd7fa4-897b-4c33-90e7-700dac43b929 tempest-TestStampPattern-2074965951 None] Deleting attachment 8470bf84-4ccc-47bf-ab7e-6a839b06266c. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:10:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Creating offline snapshot b0901d06-4688-407d-8403-4aa540f69f6c of volume c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:10:47 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e1a34-0a35-4113-859f-bd8fb9e7b3d5]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:47 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 Nov 03 13:10:47 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:47 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5" returned: 0 in 0.375s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:47 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c 1G Nov 03 13:10:47 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:48 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c 1G" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c364a2e0-8141-4927-9828-944feb3b08d5 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:48 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c364a2e0-8141-4927-9828-944feb3b08d5 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c Nov 03 13:10:48 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:48 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c364a2e0-8141-4927-9828-944feb3b08d5 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c" returned: 0 in 0.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:48 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c is being set with open permissions: ugo+rw Nov 03 13:10:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:48 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c Nov 03 13:10:48 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:48 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c" returned: 0 in 0.244s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:48 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.info Nov 03 13:10:48 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:49 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.info" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:49 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.info is being set with open permissions: ugo+rw Nov 03 13:10:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:49 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.info Nov 03 13:10:49 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:49 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.info" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-651d5c78-1caa-44e2-ba40-94d7b38b55cc tempest-TestStampPattern-2074965951 None] Create snapshot completed successfully Nov 03 13:10:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Acquiring lock "cinder-e56c1a6a-d100-470e-ad63-8c2901a15756-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Lock "cinder-e56c1a6a-d100-470e-ad63-8c2901a15756-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Acquiring lock "cinder-quobyte-e56c1a6a-d100-470e-ad63-8c2901a15756" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Lock "cinder-quobyte-e56c1a6a-d100-470e-ad63-8c2901a15756" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a4c80c-8660-45c7-a534-3e53631bf50f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:50 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 Nov 03 13:10:50 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:51 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:51 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756 Nov 03 13:10:51 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:51 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e56c1a6a-d100-470e-ad63-8c2901a15756" returned: 0 in 0.245s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Lock "cinder-quobyte-e56c1a6a-d100-470e-ad63-8c2901a15756" released by "delete_volume" :: held 0.679s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Created reservations ['54e8f402-cfb3-4574-9589-3b604ffae1c9', 'e514bf5e-3414-477a-a666-104bce75c9ab', '7136e340-4dad-4f23-aee4-403eb6c43a8f', 'cf64c751-0582-4b2d-a030-4e90ea40dbe1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:51 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:10:51 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:51 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.286s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Deleted volume successfully. Nov 03 13:10:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c52ffd89-4b7c-47e0-98fe-0cc2174b1752 tempest-VolumesNegativeTest-483184791 None] Lock "cinder-e56c1a6a-d100-470e-ad63-8c2901a15756-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=68,cinder:INSERT=25,cinder:UPDATE=72,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Flow 'volume_create_manager' (d1fd3823-e4a8-49bc-93d1-10cada081912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3054a352-b423-4337-9fbb-94619d26af9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3054a352-b423-4337-9fbb-94619d26af9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-21358005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b469c3a9714640ba41a791dc7e8f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0901d06-4688-407d-8403-4aa540f69f6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:10:56Z,use_quota=True,user_id='1668559187494bb2aefbe339dd49cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702b6c8-6416-4c00-b5c2-4338f6e0aa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702b6c8-6416-4c00-b5c2-4338f6e0aa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7868b5-ddc5-4154-94d3-4de44e19e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7868b5-ddc5-4154-94d3-4de44e19e255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3', 'volume_name': 'volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3', 'volume_size': 1, 'snapshot_id': 'b0901d06-4688-407d-8403-4aa540f69f6c'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c054a200-d64e-4b55-85ba-c4bb64547dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c054a200-d64e-4b55-85ba-c4bb64547dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db704cc-05c8-4e8b-820c-015aa15eae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:10:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Volume 50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3', 'volume_size': 1, 'snapshot_id': 'b0901d06-4688-407d-8403-4aa540f69f6c'} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-quobyte-b0901d06-4688-407d-8403-4aa540f69f6c-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-b0901d06-4688-407d-8403-4aa540f69f6c-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Creating volume 50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 from snapshot b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-quobyte-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] snapshot: b0901d06-4688-407d-8403-4aa540f69f6c, volume: 50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[602c9d28-eb58-4e6a-a3dd-3a8277e073c4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:56 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c Nov 03 13:10:56 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:57 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c364a2e0-8141-4927-9828-944feb3b08d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4e532d-b0a4-403b-b2c4-b41912ef1fb4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:57 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 Nov 03 13:10:57 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:57 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5" returned: 0 in 0.497s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:10:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:57 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 Nov 03 13:10:57 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:10:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:10:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:10:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:10:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:10:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:10:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:10:58 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:10:58 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:10:59 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Nov 03 13:10:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.703s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:10:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:10:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:10:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:10:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:11:06 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=58,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=20 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:06 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:07 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" returned: 0 in 10.045s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:07 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5, size 1024.00 MB, duration 10.05 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:11:07 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Converted 1024.00 MB image at 101.93 MB/s Nov 03 13:11:07 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 is being set with open permissions: ugo+rw Nov 03 13:11:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:07 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 Nov 03 13:11:07 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:08 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" returned: 0 in 0.347s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" released by "_copy_volume_from_snapshot" :: held 11.442s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-b0901d06-4688-407d-8403-4aa540f69f6c-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" released by "_create_volume_from_snapshot" :: held 11.535s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.552s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db704cc-05c8-4e8b-820c-015aa15eae57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3', 'volume_size': 1, 'snapshot_id': 'b0901d06-4688-407d-8403-4aa540f69f6c'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce0893e-4ef9-4fff-8f58-c56b22a8aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Volume volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 (50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3): created successfully Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce0893e-4ef9-4fff-8f58-c56b22a8aea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Flow 'volume_create_manager' (d1fd3823-e4a8-49bc-93d1-10cada081912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-916635f3-442d-4d8d-a1a9-3ebf699d27c1 tempest-TestStampPattern-2074965951 None] Created volume successfully. Nov 03 13:11:18 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:18 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Flow 'volume_create_manager' (754a33a6-582c-4cb4-a480-8793fc4ad842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e515ac-8021-4922-a5ee-88a4f38f42c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e515ac-8021-4922-a5ee-88a4f38f42c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1334071608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625a5dc1-d82f-4b8d-86ee-d8103e16d2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8630f89b538c496c95f9c591bff46634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:31Z,use_quota=True,user_id='173046bbd82b47dfbeccb1a1af593dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d6c0b1-6272-4e49-baea-4c241d3c6d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d6c0b1-6272-4e49-baea-4c241d3c6d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95ed035-c817-4dbd-9ee4-48400f13cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95ed035-c817-4dbd-9ee4-48400f13cb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625a5dc1-d82f-4b8d-86ee-d8103e16d2c3', 'volume_name': 'volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17892fb5-4abb-4af7-bd0a-f2f6efda0812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17892fb5-4abb-4af7-bd0a-f2f6efda0812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eefd144-54d0-4ba4-b61b-c54973c61417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Volume 625a5dc1-d82f-4b8d-86ee-d8103e16d2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3', 'volume_size': 1} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1334071608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625a5dc1-d82f-4b8d-86ee-d8103e16d2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8630f89b538c496c95f9c591bff46634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:11:31Z,use_quota=True,user_id='173046bbd82b47dfbeccb1a1af593dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Creating volume 625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:11:31 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:31 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 1073741824 Nov 03 13:11:31 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:31 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 1073741824" returned: 0 in 0.482s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:31 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 Nov 03 13:11:31 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:32 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:11:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eefd144-54d0-4ba4-b61b-c54973c61417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2677c8ed-ea1a-4885-ad3a-c5253fdfd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:11:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Volume volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 (625a5dc1-d82f-4b8d-86ee-d8103e16d2c3): created successfully Nov 03 13:11:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2677c8ed-ea1a-4885-ad3a-c5253fdfd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:11:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Flow 'volume_create_manager' (754a33a6-582c-4cb4-a480-8793fc4ad842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:11:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a7083c4e-913c-4ab9-9245-7326a878dfe9 tempest-TestMinimumBasicScenario-743747771 None] Created volume successfully. Nov 03 13:11:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-4994987b-fa61-4e9a-bc45-788055a1d68c req-099ddafb-b759-45ee-8be2-39d4edbe0752 tempest-TestMinimumBasicScenario-743747771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-4994987b-fa61-4e9a-bc45-788055a1d68c req-099ddafb-b759-45ee-8be2-39d4edbe0752 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-4994987b-fa61-4e9a-bc45-788055a1d68c req-099ddafb-b759-45ee-8be2-39d4edbe0752 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-4994987b-fa61-4e9a-bc45-788055a1d68c req-099ddafb-b759-45ee-8be2-39d4edbe0752 tempest-TestMinimumBasicScenario-743747771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '410eaeae-0741-4293-a9e8-f30b055fa1ec', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:11:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-4994987b-fa61-4e9a-bc45-788055a1d68c req-099ddafb-b759-45ee-8be2-39d4edbe0752 tempest-TestMinimumBasicScenario-743747771 None] attachment_update completed successfully. Nov 03 13:11:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-64b9aee8-328e-4077-bfc9-5d987a2089f8 req-98c530b9-cfdf-4d40-be08-4ab8eedfe447 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-64b9aee8-328e-4077-bfc9-5d987a2089f8 req-98c530b9-cfdf-4d40-be08-4ab8eedfe447 tempest-TestStampPattern-2074965951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-64b9aee8-328e-4077-bfc9-5d987a2089f8 req-98c530b9-cfdf-4d40-be08-4ab8eedfe447 tempest-TestStampPattern-2074965951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-64b9aee8-328e-4077-bfc9-5d987a2089f8 req-98c530b9-cfdf-4d40-be08-4ab8eedfe447 tempest-TestStampPattern-2074965951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25', 'name': 'volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5590961e-b79c-4c71-a0dd-f2f400e40926', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 13:11:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-64b9aee8-328e-4077-bfc9-5d987a2089f8 req-98c530b9-cfdf-4d40-be08-4ab8eedfe447 tempest-TestStampPattern-2074965951 None] attachment_update completed successfully. Nov 03 13:11:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-17f27757-1047-4d32-a515-d9a3b053e178 req-32ce9d81-d7ac-40ef-99d3-c889771fc92b tempest-TestStampPattern-2074965951 None] Terminate volume connection completed successfully. Nov 03 13:11:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-17f27757-1047-4d32-a515-d9a3b053e178 req-32ce9d81-d7ac-40ef-99d3-c889771fc92b tempest-TestStampPattern-2074965951 None] Deleting attachment 5590961e-b79c-4c71-a0dd-f2f400e40926. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:11:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Lock "cinder-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-quobyte-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4389512d-527d-4e79-ba8a-f398fbbde687]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:44 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 Nov 03 13:11:44 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:44 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:44 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3 Nov 03 13:11:44 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:44 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3" released by "delete_volume" :: held 0.703s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Created reservations ['63692c82-5ae8-4028-8886-f03beede7aec', '9314b432-26e6-40dd-8101-c89af74b2cdc', 'fbc0d567-a41f-4298-a97b-23e10bd825ac', 'fa43289b-7edb-424a-ba8c-1c0ec98e1987'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:44 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:11:44 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:45 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:11:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Deleted volume successfully. Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fecf5917-67f8-406c-ab71-22f7bbdecbf8 tempest-TestStampPattern-2074965951 None] Lock "cinder-50b615a7-7ee3-4ec9-ba32-9b3cb4d6e6a3-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-b0901d06-4688-407d-8403-4aa540f69f6c-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Lock "cinder-b0901d06-4688-407d-8403-4aa540f69f6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-quobyte-c364a2e0-8141-4927-9828-944feb3b08d5" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-c364a2e0-8141-4927-9828-944feb3b08d5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-quobyte-b0901d06-4688-407d-8403-4aa540f69f6c" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-b0901d06-4688-407d-8403-4aa540f69f6c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Deleting offline snapshot b0901d06-4688-407d-8403-4aa540f69f6c of volume c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] snapshot_file for this snap is: volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f08208-8684-4ca7-aacb-080cf915d51c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:45 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c Nov 03 13:11:45 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:45 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c" returned: 0 in 0.380s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c364a2e0-8141-4927-9828-944feb3b08d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04f51b5-f91e-46e3-9f53-e2b568bc5cbd]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:46 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 Nov 03 13:11:46 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:46 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5" returned: 0 in 0.530s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:46 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c Nov 03 13:11:46 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:46 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:46 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c Nov 03 13:11:46 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:46 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5.b0901d06-4688-407d-8403-4aa540f69f6c" returned: 0 in 0.242s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-b0901d06-4688-407d-8403-4aa540f69f6c" released by "_delete_snapshot" :: held 1.587s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-c364a2e0-8141-4927-9828-944feb3b08d5" released by "delete_snapshot" :: held 1.608s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:47 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Created reservations ['54f63876-5628-43f9-8ab9-10ab7bceb465', '739776af-5e1e-487b-97fc-f85876d65067', '555dd7bd-188d-41e9-8477-6a2d5319d973', '570f1eeb-5687-47f6-854e-fa63e33201d3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:11:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Delete snapshot completed successfully. Nov 03 13:11:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e8c835-3ab3-493c-a896-5045c2646f7d tempest-TestStampPattern-2074965951 None] Lock "cinder-b0901d06-4688-407d-8403-4aa540f69f6c-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-c364a2e0-8141-4927-9828-944feb3b08d5-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Lock "cinder-c364a2e0-8141-4927-9828-944feb3b08d5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Acquiring lock "cinder-quobyte-c364a2e0-8141-4927-9828-944feb3b08d5" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-c364a2e0-8141-4927-9828-944feb3b08d5" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4169a5-6193-4d22-8f02-976ce63188f2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:51 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 Nov 03 13:11:51 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:51 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5" returned: 0 in 0.414s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:51 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5 Nov 03 13:11:51 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:52 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c364a2e0-8141-4927-9828-944feb3b08d5" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Lock "cinder-quobyte-c364a2e0-8141-4927-9828-944feb3b08d5" released by "delete_volume" :: held 0.770s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Created reservations ['0a775467-d1d8-4d64-906c-13f65f979dbc', '3231e0d4-068c-44b9-bb10-2e52fe2ed811', '42761dad-e1f2-4f8c-9b42-571725eed8da', '8f97759a-6b0f-4c0d-b07b-a0953c27606d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:52 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:11:52 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:52 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.248s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:11:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Deleted volume successfully. Nov 03 13:11:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7de5892d-75af-4a71-8ec8-2c2481374e4d tempest-TestStampPattern-2074965951 None] Lock "cinder-c364a2e0-8141-4927-9828-944feb3b08d5-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:11:58 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:11:58 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:11:58 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:11:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:11:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:11:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:11:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:12:02 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=32,cinder:SELECT=29,cinder:INSERT=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:12:02 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=35,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (743550b3-0533-42ba-9991-122b9cf48606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2cce9b-4b50-492e-b0d1-791158d0c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2cce9b-4b50-492e-b0d1-791158d0c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726507380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a0d744-b30a-408d-9082-e1c34bade7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:06Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc5f5b1-995e-4b92-95d4-f84aa527bb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc5f5b1-995e-4b92-95d4-f84aa527bb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7c8234-becf-4047-a660-dacd0eacafc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7c8234-becf-4047-a660-dacd0eacafc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a0d744-b30a-408d-9082-e1c34bade7c2', 'volume_name': 'volume-56a0d744-b30a-408d-9082-e1c34bade7c2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11334376-ecb6-4b3b-b0a3-2bfb16e69a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11334376-ecb6-4b3b-b0a3-2bfb16e69a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a93cff-0e64-4fcc-aba4-633bdbc0ade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume 56a0d744-b30a-408d-9082-e1c34bade7c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a0d744-b30a-408d-9082-e1c34bade7c2', 'volume_size': 1} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726507380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a0d744-b30a-408d-9082-e1c34bade7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:06Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Creating volume 56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:05 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 1073741824 Nov 03 13:12:05 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:06 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 1073741824" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:06 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 Nov 03 13:12:06 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:06 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a93cff-0e64-4fcc-aba4-633bdbc0ade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a0d744-b30a-408d-9082-e1c34bade7c2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5fccc2-fca9-48ae-a237-1b75b7db3961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume volume-56a0d744-b30a-408d-9082-e1c34bade7c2 (56a0d744-b30a-408d-9082-e1c34bade7c2): created successfully Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5fccc2-fca9-48ae-a237-1b75b7db3961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (743550b3-0533-42ba-9991-122b9cf48606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d621b873-1b04-422d-873f-28499d9b9c69 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created volume successfully. Nov 03 13:12:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Creating offline snapshot 37c12e56-9c6a-4301-a19d-f6461f5ace32 of volume 56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5b707-3ec1-40a6-94d3-4916057f75ee]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:08 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 Nov 03 13:12:08 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:08 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2" returned: 0 in 0.426s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:08 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 1G Nov 03 13:12:08 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:08 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 1G" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a0d744-b30a-408d-9082-e1c34bade7c2 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:08 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a0d744-b30a-408d-9082-e1c34bade7c2 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 Nov 03 13:12:08 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:09 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a0d744-b30a-408d-9082-e1c34bade7c2 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32" returned: 0 in 0.308s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:09 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 is being set with open permissions: ugo+rw Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:09 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 Nov 03 13:12:09 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:09 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32" returned: 0 in 0.254s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:09 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.info Nov 03 13:12:09 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:09 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.info" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:09 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.info is being set with open permissions: ugo+rw Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:09 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.info Nov 03 13:12:09 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:09 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.info" returned: 0 in 0.248s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-db361122-f88a-459f-9446-64d182fa1cc9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Create snapshot completed successfully Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (37019e45-06cb-47ef-9309-62291e84184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584c868e-4e65-4134-a838-b19c806b7144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584c868e-4e65-4134-a838-b19c806b7144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061355580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8065f6de-686e-414c-85fc-529c093d946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:11Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b03eea-42a0-4ce0-a09f-0b970c5b964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b03eea-42a0-4ce0-a09f-0b970c5b964f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cbb63d-f72d-4817-a63f-b396d41ec9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cbb63d-f72d-4817-a63f-b396d41ec9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8065f6de-686e-414c-85fc-529c093d946d', 'volume_name': 'volume-8065f6de-686e-414c-85fc-529c093d946d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7638d296-f1f5-4581-9807-ce37d35166fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7638d296-f1f5-4581-9807-ce37d35166fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8af24b-03e6-4395-85fb-3b106a21fd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume 8065f6de-686e-414c-85fc-529c093d946d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8065f6de-686e-414c-85fc-529c093d946d', 'volume_size': 1} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061355580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8065f6de-686e-414c-85fc-529c093d946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:11Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Creating volume 8065f6de-686e-414c-85fc-529c093d946d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:11 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:11 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d 1073741824 Nov 03 13:12:11 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (0786ba6f-24be-41ba-8a14-e3224d105376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb43dce-9535-40bc-baaa-90613dc030f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb43dce-9535-40bc-baaa-90613dc030f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602489054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d1fd49-0215-4c27-9bb5-461e5f7387fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:12Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f316bf-4003-4fa8-8669-d277d8f0fa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f316bf-4003-4fa8-8669-d277d8f0fa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd086167-2db0-4394-940f-049b03ee0db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd086167-2db0-4394-940f-049b03ee0db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d1fd49-0215-4c27-9bb5-461e5f7387fb', 'volume_name': 'volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8facb545-9f73-4adb-8446-46135ce0a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8facb545-9f73-4adb-8446-46135ce0a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b724b5-f1ec-4c6d-98e4-29e7c50a9519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume 53d1fd49-0215-4c27-9bb5-461e5f7387fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb', 'volume_size': 1} Nov 03 13:12:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:12 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d 1073741824" returned: 0 in 0.554s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:12 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d Nov 03 13:12:12 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (20b59d62-6a63-4292-ab9e-51f080c46b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc7cbf6-bb48-4b0e-ab22-7b7ef202e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc7cbf6-bb48-4b0e-ab22-7b7ef202e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701955711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe1b8dc-a88d-40d9-99e0-d87127f46fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:12Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e11e18-1462-41fc-93db-2feb8deafe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e11e18-1462-41fc-93db-2feb8deafe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381b3102-8346-437c-a236-525891d9cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381b3102-8346-437c-a236-525891d9cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe1b8dc-a88d-40d9-99e0-d87127f46fe5', 'volume_name': 'volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027203b3-5d03-4ce4-9b6b-a4f33c23671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027203b3-5d03-4ce4-9b6b-a4f33c23671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d4025e-9a0b-44bc-9422-b5973c03a9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume bbe1b8dc-a88d-40d9-99e0-d87127f46fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5', 'volume_size': 1} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:12 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602489054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d1fd49-0215-4c27-9bb5-461e5f7387fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:12Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Creating volume 53d1fd49-0215-4c27-9bb5-461e5f7387fb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:12 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:12 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb 1073741824 Nov 03 13:12:12 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8af24b-03e6-4395-85fb-3b106a21fd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8065f6de-686e-414c-85fc-529c093d946d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b092e02-ccf9-4fa5-9a98-eb886d35a704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume volume-8065f6de-686e-414c-85fc-529c093d946d (8065f6de-686e-414c-85fc-529c093d946d): created successfully Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b092e02-ccf9-4fa5-9a98-eb886d35a704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (37019e45-06cb-47ef-9309-62291e84184e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fb8adb6d-4487-4637-a373-57c5243e4546 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created volume successfully. Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (04c28fd2-d85f-4225-a219-4d6cf88ee2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab910924-8c64-4a2c-a7bf-bcba54c2f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab910924-8c64-4a2c-a7bf-bcba54c2f435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255366316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67061f0-8c39-4d46-97c2-2e720fd06c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:13Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bb67fa-1bcb-4e43-bd30-5b218eea436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bb67fa-1bcb-4e43-bd30-5b218eea436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a231f9-b20e-466f-80df-097873c415ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a231f9-b20e-466f-80df-097873c415ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67061f0-8c39-4d46-97c2-2e720fd06c12', 'volume_name': 'volume-e67061f0-8c39-4d46-97c2-2e720fd06c12', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b58b4-da52-42d6-92d4-9307e0c181d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b58b4-da52-42d6-92d4-9307e0c181d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1b8855-37e8-4c69-ad3a-c22a46c18c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume e67061f0-8c39-4d46-97c2-2e720fd06c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67061f0-8c39-4d46-97c2-2e720fd06c12', 'volume_size': 1} Nov 03 13:12:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:13 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb 1073741824" returned: 0 in 0.546s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (5a416b49-0a0b-4860-97bc-8339e5a9da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571b47c6-c55e-4bea-8a4c-546b0ad2e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571b47c6-c55e-4bea-8a4c-546b0ad2e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794639538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c057d8bf-2116-4180-b46a-f4bc3524180a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:13Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:13 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb Nov 03 13:12:13 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0758463b-533b-4e9a-b814-1cafca300d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0758463b-533b-4e9a-b814-1cafca300d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5f5386-33f5-4b93-88ea-0bcfd57e3335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5f5386-33f5-4b93-88ea-0bcfd57e3335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c057d8bf-2116-4180-b46a-f4bc3524180a', 'volume_name': 'volume-c057d8bf-2116-4180-b46a-f4bc3524180a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fe7fab-ba67-46a0-8920-7a7c15e46bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fe7fab-ba67-46a0-8920-7a7c15e46bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea4be26-ac75-4c9f-bf12-dac9a443c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume c057d8bf-2116-4180-b46a-f4bc3524180a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c057d8bf-2116-4180-b46a-f4bc3524180a', 'volume_size': 1} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:13 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701955711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe1b8dc-a88d-40d9-99e0-d87127f46fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:12Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Creating volume bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:13 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b724b5-f1ec-4c6d-98e4-29e7c50a9519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:13 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 1073741824 Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b40dbd-bb77-46eb-97aa-fe69dac0a111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:13 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb (53d1fd49-0215-4c27-9bb5-461e5f7387fb): created successfully Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b40dbd-bb77-46eb-97aa-fe69dac0a111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (0786ba6f-24be-41ba-8a14-e3224d105376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4c2b0cab-2a1d-401c-a0f6-d0f35be5fe9b tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created volume successfully. Nov 03 13:12:13 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 1073741824" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:13 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 Nov 03 13:12:13 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:14 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255366316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67061f0-8c39-4d46-97c2-2e720fd06c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:13Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Creating volume e67061f0-8c39-4d46-97c2-2e720fd06c12 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d4025e-9a0b-44bc-9422-b5973c03a9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:14 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 1073741824 Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1bf823-d971-416a-87af-c7161e93ec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:14 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 (bbe1b8dc-a88d-40d9-99e0-d87127f46fe5): created successfully Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1bf823-d971-416a-87af-c7161e93ec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (20b59d62-6a63-4292-ab9e-51f080c46b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7b454dd9-24e7-4215-aa97-342b7a198f8a tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created volume successfully. Nov 03 13:12:14 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 1073741824" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:14 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 Nov 03 13:12:14 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:14 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.655s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794639538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c057d8bf-2116-4180-b46a-f4bc3524180a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0396d07d480a4b8d820bb967183f0fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:13Z,use_quota=True,user_id='f8ea45df0c1c45ba9aa29a0bd3af834d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Creating volume c057d8bf-2116-4180-b46a-f4bc3524180a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1b8855-37e8-4c69-ad3a-c22a46c18c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67061f0-8c39-4d46-97c2-2e720fd06c12', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d3dbf7-e0b5-4449-9146-d39b86116d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:14 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a 1073741824 Nov 03 13:12:14 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 (e67061f0-8c39-4d46-97c2-2e720fd06c12): created successfully Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d3dbf7-e0b5-4449-9146-d39b86116d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (04c28fd2-d85f-4225-a219-4d6cf88ee2e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bb366a22-b843-4ee5-a831-0c7b8bd3abc2 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created volume successfully. Nov 03 13:12:15 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a 1073741824" returned: 0 in 0.455s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:15 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a Nov 03 13:12:15 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:15 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea4be26-ac75-4c9f-bf12-dac9a443c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c057d8bf-2116-4180-b46a-f4bc3524180a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be851f9d-d126-40c3-b8bc-7d0c1ec1f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Volume volume-c057d8bf-2116-4180-b46a-f4bc3524180a (c057d8bf-2116-4180-b46a-f4bc3524180a): created successfully Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be851f9d-d126-40c3-b8bc-7d0c1ec1f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Flow 'volume_create_manager' (5a416b49-0a0b-4860-97bc-8339e5a9da4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-83b6bba7-2bc2-4069-815a-6e144cb448ef tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created volume successfully. Nov 03 13:12:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-c057d8bf-2116-4180-b46a-f4bc3524180a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-c057d8bf-2116-4180-b46a-f4bc3524180a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-c057d8bf-2116-4180-b46a-f4bc3524180a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-c057d8bf-2116-4180-b46a-f4bc3524180a" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315061d-aef7-48e4-b6f2-e2bfcb7c1835]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:16 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a Nov 03 13:12:16 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:17 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:17 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a Nov 03 13:12:17 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:17 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c057d8bf-2116-4180-b46a-f4bc3524180a" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-c057d8bf-2116-4180-b46a-f4bc3524180a" released by "delete_volume" :: held 0.710s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created reservations ['0b6e9fed-6279-4e60-be37-3ee203c71ed1', '5e76698e-c8c0-49de-aae2-c0ffda207c68', '6e53f198-b725-420c-ac1a-cf92ffe30e21', '3977a979-ba6b-4eed-af96-18c2fa75dc73'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:17 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:17 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-e67061f0-8c39-4d46-97c2-2e720fd06c12-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:17 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Deleted volume successfully. Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-e67061f0-8c39-4d46-97c2-2e720fd06c12-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a1830952-c2fb-4d44-86b1-f8a42e556691 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-c057d8bf-2116-4180-b46a-f4bc3524180a-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-e67061f0-8c39-4d46-97c2-2e720fd06c12" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-e67061f0-8c39-4d46-97c2-2e720fd06c12" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1afce39-d6b7-4ec2-9771-cce294c7aa5c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:17 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 Nov 03 13:12:17 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:18 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:18 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12 Nov 03 13:12:18 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:18 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e67061f0-8c39-4d46-97c2-2e720fd06c12" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-e67061f0-8c39-4d46-97c2-2e720fd06c12" released by "delete_volume" :: held 0.690s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created reservations ['bb101273-4c2d-48d2-b57a-45882a8573b0', '4f87f7a5-612f-4df8-998d-c0af79b0aaba', 'eed246a0-976d-4aec-89f8-50d7f0fa6d47', '96adec35-0064-4fb0-8bd8-b0a74ffec1a9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:18 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:18 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:18 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Deleted volume successfully. Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4d13f076-e43b-4c1d-8e07-1f5a62cc5e74 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-e67061f0-8c39-4d46-97c2-2e720fd06c12-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[25daad20-6308-4cfb-960b-9bda4f1a3206]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:19 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 Nov 03 13:12:19 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:19 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5" returned: 0 in 0.450s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:19 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5 Nov 03 13:12:19 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:19 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5" released by "delete_volume" :: held 0.822s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created reservations ['87057194-89b3-4fcc-a0ff-3fba25c2a24c', '997e46eb-9e64-4db3-9c3c-f859e7565fde', '0cfdfdba-131b-402d-88d7-8de3e0eca3f9', 'aece3b2b-020b-4505-b80f-8a3e1caf9730'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:20 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:20 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-53d1fd49-0215-4c27-9bb5-461e5f7387fb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-53d1fd49-0215-4c27-9bb5-461e5f7387fb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-53d1fd49-0215-4c27-9bb5-461e5f7387fb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-53d1fd49-0215-4c27-9bb5-461e5f7387fb" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3854fc1c-b1dd-4d80-aea9-d9f879439cd1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:20 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Deleted volume successfully. Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-62005074-2a1f-4938-bd7b-32631cd0a6c3 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-bbe1b8dc-a88d-40d9-99e0-d87127f46fe5-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:20 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb Nov 03 13:12:20 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:20 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb" returned: 0 in 0.444s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:20 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb Nov 03 13:12:20 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-d37b3b24-1bc3-4f42-a8ef-1d2f52fb9f85 req-742c9e7a-ad87-4f4e-8d15-6d639d41857b tempest-TestMinimumBasicScenario-743747771 None] Terminate volume connection completed successfully. Nov 03 13:12:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-d37b3b24-1bc3-4f42-a8ef-1d2f52fb9f85 req-742c9e7a-ad87-4f4e-8d15-6d639d41857b tempest-TestMinimumBasicScenario-743747771 None] Deleting attachment 410eaeae-0741-4293-a9e8-f30b055fa1ec. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 13:12:21 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-53d1fd49-0215-4c27-9bb5-461e5f7387fb" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-53d1fd49-0215-4c27-9bb5-461e5f7387fb" released by "delete_volume" :: held 0.815s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created reservations ['a02231a2-526a-49e2-81e2-9ba53fb3b1ab', 'f7bc5a14-e121-4f71-b052-f3e78ef09b13', '196f9c6b-2df5-4967-89f4-33d78c94463a', '9209f905-5230-4bde-b7fc-c24a897a722d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:21 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:21 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-8065f6de-686e-414c-85fc-529c093d946d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-8065f6de-686e-414c-85fc-529c093d946d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-8065f6de-686e-414c-85fc-529c093d946d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-8065f6de-686e-414c-85fc-529c093d946d" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d210f85-511d-4fd7-b4d6-155327bd0d3e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:21 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.281s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Deleted volume successfully. Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3b7cd24c-af38-42ad-b78e-e1d8ffbd08f9 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-53d1fd49-0215-4c27-9bb5-461e5f7387fb-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:21 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d Nov 03 13:12:21 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Acquiring lock "cinder-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Lock "cinder-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Acquiring lock "cinder-quobyte-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Lock "cinder-quobyte-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:21 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d" returned: 0 in 0.437s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e780cd-f581-4e82-af81-f277c83f0a94]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:21 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d Nov 03 13:12:21 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:22 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 Nov 03 13:12:22 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:22 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8065f6de-686e-414c-85fc-529c093d946d" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-8065f6de-686e-414c-85fc-529c093d946d" released by "delete_volume" :: held 0.759s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created reservations ['28c4885b-43bd-4fa7-845d-fe8bff523050', 'b0bb6307-7912-4eef-ade5-2d0b872f2c55', '1cb442ad-fa41-42f8-b6ec-1c9f4fffa63c', 'a92c765f-813c-4d4d-8cbc-fae582c719e0'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:22 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:22 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:22 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:22 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3 Nov 03 13:12:22 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-37c12e56-9c6a-4301-a19d-f6461f5ace32-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-37c12e56-9c6a-4301-a19d-f6461f5ace32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-56a0d744-b30a-408d-9082-e1c34bade7c2" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-56a0d744-b30a-408d-9082-e1c34bade7c2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-37c12e56-9c6a-4301-a19d-f6461f5ace32" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:22 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:22 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-37c12e56-9c6a-4301-a19d-f6461f5ace32" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Deleting offline snapshot 37c12e56-9c6a-4301-a19d-f6461f5ace32 of volume 56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] snapshot_file for this snap is: volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:12:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Deleted volume successfully. Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[27214449-3e52-4451-9105-3957109cfb5b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Lock "cinder-quobyte-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3" released by "delete_volume" :: held 0.788s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-817c9f87-0e07-460f-bc2b-2e58723f6d55 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-8065f6de-686e-414c-85fc-529c093d946d-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Created reservations ['b054a376-b533-4ce3-bf2d-58c9b4bdbc6e', '2948e332-fc11-430b-ac20-8f88f0180951', '6d667dad-03ae-407b-b9be-e4fb51648960', 'cc46c217-0923-4ec8-97e0-fd1c61be666d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:22 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 Nov 03 13:12:22 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:22 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:22 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:23 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32" returned: 0 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56a0d744-b30a-408d-9082-e1c34bade7c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:23 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Deleted volume successfully. Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ff9e1-b584-4a1a-9ed1-8fa7f87886e2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-37568040-0b67-468d-a496-e9532d4ded63 tempest-TestMinimumBasicScenario-743747771 None] Lock "cinder-625a5dc1-d82f-4b8d-86ee-d8103e16d2c3-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:23 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 Nov 03 13:12:23 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:23 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:23 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 Nov 03 13:12:23 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:24 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:24 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32 Nov 03 13:12:24 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:24 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2.37c12e56-9c6a-4301-a19d-f6461f5ace32" returned: 0 in 0.325s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-37c12e56-9c6a-4301-a19d-f6461f5ace32" released by "_delete_snapshot" :: held 1.806s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-56a0d744-b30a-408d-9082-e1c34bade7c2" released by "delete_snapshot" :: held 1.838s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created reservations ['76175389-3798-4954-bc31-5935844beca3', '4bc069d2-5561-4175-9091-cb8f7b43fbbb', '14d2841a-17f9-4eec-9484-f72b5360039b', '6c80d18b-7fed-41b6-b8bb-637a0f4cf9a4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Delete snapshot completed successfully. Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09d38bf-59a7-4d96-a612-c268639112f8 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-37c12e56-9c6a-4301-a19d-f6461f5ace32-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-56a0d744-b30a-408d-9082-e1c34bade7c2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-56a0d744-b30a-408d-9082-e1c34bade7c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "cinder-quobyte-56a0d744-b30a-408d-9082-e1c34bade7c2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-56a0d744-b30a-408d-9082-e1c34bade7c2" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd654bd-5151-40e4-b9cf-9ce69f90135e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:24 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 Nov 03 13:12:24 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:25 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2" returned: 0 in 0.402s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:25 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2 Nov 03 13:12:25 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:25 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-56a0d744-b30a-408d-9082-e1c34bade7c2" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-quobyte-56a0d744-b30a-408d-9082-e1c34bade7c2" released by "delete_volume" :: held 0.728s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Created reservations ['b736019d-07f0-4df1-ad0b-1ad84ded0011', 'eb7378a3-33d9-47de-82e2-f867089aa44d', '19f72a28-7bce-407e-9b59-b702d0f2e673', '8009383e-3654-4743-99ff-98656ae87f5c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:25 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:25 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:25 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Deleted volume successfully. Nov 03 13:12:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f58c45ca-380d-47cc-85c9-f7cd919e3a00 tempest-CreateVolumesFromSnapshotTest-1119405645 None] Lock "cinder-56a0d744-b30a-408d-9082-e1c34bade7c2-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Flow 'volume_create_manager' (8c647656-76c7-4a05-86f2-cdaa50ecfd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e63db5-fa7a-4e5f-a46b-b1026ef7a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e63db5-fa7a-4e5f-a46b-b1026ef7a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2010535709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4443ae51-7bff-4ae7-b462-5e97443189eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bb71c09c424caa847914a61c84e00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:29Z,use_quota=True,user_id='8b7e0fdd688a452a8c8a5ce9788b509e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6d3530-ea6f-49c0-86f0-bb4ab270bbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6d3530-ea6f-49c0-86f0-bb4ab270bbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e20cb-713e-4a34-b324-e84b90ec3847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e20cb-713e-4a34-b324-e84b90ec3847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4443ae51-7bff-4ae7-b462-5e97443189eb', 'volume_name': 'volume-4443ae51-7bff-4ae7-b462-5e97443189eb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25b6e8b-4be5-46dc-9488-da0d73630504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25b6e8b-4be5-46dc-9488-da0d73630504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af052a53-09ad-4f1b-99bc-7f652a5f1218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Volume 4443ae51-7bff-4ae7-b462-5e97443189eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4443ae51-7bff-4ae7-b462-5e97443189eb', 'volume_size': 1} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2010535709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4443ae51-7bff-4ae7-b462-5e97443189eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bb71c09c424caa847914a61c84e00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:29Z,use_quota=True,user_id='8b7e0fdd688a452a8c8a5ce9788b509e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Creating volume 4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:28 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:28 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb 1073741824 Nov 03 13:12:28 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:29 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb 1073741824" returned: 0 in 0.498s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:29 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb Nov 03 13:12:29 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:29 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af052a53-09ad-4f1b-99bc-7f652a5f1218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4443ae51-7bff-4ae7-b462-5e97443189eb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12781e4f-1b9b-413f-b0d5-5b02718b6973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:29 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Volume volume-4443ae51-7bff-4ae7-b462-5e97443189eb (4443ae51-7bff-4ae7-b462-5e97443189eb): created successfully Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12781e4f-1b9b-413f-b0d5-5b02718b6973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Flow 'volume_create_manager' (8c647656-76c7-4a05-86f2-cdaa50ecfd51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-006f20a0-b614-4f37-9b06-55dd743bc693 tempest-VolumeDependencyTests-321869931 None] Created volume successfully. Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Creating offline snapshot 4e324bda-2395-46ce-b3e4-951d73bc5956 of volume 4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea53da-112b-4693-a584-ecd8a0c569d7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:31 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb Nov 03 13:12:31 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:31 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:31 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 1G Nov 03 13:12:31 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:31 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 1G" returned: 0 in 0.404s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4443ae51-7bff-4ae7-b462-5e97443189eb -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:31 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4443ae51-7bff-4ae7-b462-5e97443189eb -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 Nov 03 13:12:31 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:32 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4443ae51-7bff-4ae7-b462-5e97443189eb -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:32 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 is being set with open permissions: ugo+rw Nov 03 13:12:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:32 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 Nov 03 13:12:32 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:32 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:32 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.info Nov 03 13:12:32 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:32 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.info" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:32 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.info is being set with open permissions: ugo+rw Nov 03 13:12:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:32 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.info Nov 03 13:12:32 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:33 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.info" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-774ac8c8-5afc-4cab-ac85-2ed56d26b971 tempest-VolumeDependencyTests-321869931 None] Create snapshot completed successfully Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Flow 'volume_create_manager' (865ac2b7-9b00-4c60-b040-4cf4512a3555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cbe78b-af41-4133-b5c0-d014d8b30530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cbe78b-af41-4133-b5c0-d014d8b30530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2059481529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb83d51c-91fc-4acd-b2d5-c1e3c5742432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bb71c09c424caa847914a61c84e00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e324bda-2395-46ce-b3e4-951d73bc5956,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:34Z,use_quota=True,user_id='8b7e0fdd688a452a8c8a5ce9788b509e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112afbc8-e41b-4912-9231-fdcd427f548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112afbc8-e41b-4912-9231-fdcd427f548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f0d9b6-bd1f-4b0a-8f6d-1b2d77349daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f0d9b6-bd1f-4b0a-8f6d-1b2d77349daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb83d51c-91fc-4acd-b2d5-c1e3c5742432', 'volume_name': 'volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432', 'volume_size': 1, 'snapshot_id': '4e324bda-2395-46ce-b3e4-951d73bc5956'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cea5db-821c-4aa9-9ed1-c0ee2fd5a41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cea5db-821c-4aa9-9ed1-c0ee2fd5a41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd900a-e328-458f-b5ff-521a14a517ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Volume bb83d51c-91fc-4acd-b2d5-c1e3c5742432: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432', 'volume_size': 1, 'snapshot_id': '4e324bda-2395-46ce-b3e4-951d73bc5956'} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-quobyte-4e324bda-2395-46ce-b3e4-951d73bc5956-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4e324bda-2395-46ce-b3e4-951d73bc5956-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Creating volume bb83d51c-91fc-4acd-b2d5-c1e3c5742432 from snapshot 4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-quobyte-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] snapshot: 4e324bda-2395-46ce-b3e4-951d73bc5956, volume: bb83d51c-91fc-4acd-b2d5-c1e3c5742432, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f4a98-909e-43f4-a761-44fb3557018a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:34 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 Nov 03 13:12:34 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:34 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4443ae51-7bff-4ae7-b462-5e97443189eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba705de8-e8fd-4ce1-bea9-f4a479b1e5b9]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:34 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb Nov 03 13:12:34 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:34 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:12:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:34 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 Nov 03 13:12:34 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:41 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" returned: 0 in 6.792s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:12:41 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Converted 1024.00 MB image at 150.73 MB/s Nov 03 13:12:41 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 is being set with open permissions: ugo+rw Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:41 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 Nov 03 13:12:41 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:41 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" returned: 0 in 0.244s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" released by "_copy_volume_from_snapshot" :: held 7.994s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4e324bda-2395-46ce-b3e4-951d73bc5956-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" released by "_create_volume_from_snapshot" :: held 8.058s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.074s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd900a-e328-458f-b5ff-521a14a517ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432', 'volume_size': 1, 'snapshot_id': '4e324bda-2395-46ce-b3e4-951d73bc5956'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fad2376-f58f-4906-8894-caf70c2c808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:41 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Volume volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 (bb83d51c-91fc-4acd-b2d5-c1e3c5742432): created successfully Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fad2376-f58f-4906-8894-caf70c2c808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Flow 'volume_create_manager' (865ac2b7-9b00-4c60-b040-4cf4512a3555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ad295de4-2294-4186-8a76-2efb7e4f8026 tempest-VolumeDependencyTests-321869931 None] Created volume successfully. Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-4e324bda-2395-46ce-b3e4-951d73bc5956-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Lock "cinder-4e324bda-2395-46ce-b3e4-951d73bc5956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-quobyte-4443ae51-7bff-4ae7-b462-5e97443189eb" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4443ae51-7bff-4ae7-b462-5e97443189eb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-quobyte-4e324bda-2395-46ce-b3e4-951d73bc5956" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4e324bda-2395-46ce-b3e4-951d73bc5956" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Deleting offline snapshot 4e324bda-2395-46ce-b3e4-951d73bc5956 of volume 4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] snapshot_file for this snap is: volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0aabd3-5519-4a1a-9caf-8f357be3ea6f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:42 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 Nov 03 13:12:42 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:42 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4443ae51-7bff-4ae7-b462-5e97443189eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a7e57a-6427-415c-b100-8ebd82d7098a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:43 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb Nov 03 13:12:43 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:43 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb" returned: 0 in 0.581s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:43 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 Nov 03 13:12:43 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:43 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:43 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956 Nov 03 13:12:43 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:44 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb.4e324bda-2395-46ce-b3e4-951d73bc5956" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4e324bda-2395-46ce-b3e4-951d73bc5956" released by "_delete_snapshot" :: held 1.713s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4443ae51-7bff-4ae7-b462-5e97443189eb" released by "delete_snapshot" :: held 1.736s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Created reservations ['1edb678e-6b19-49c1-a829-8b93dd36a988', '187ba810-7bf4-43cf-99f3-142dddbaedb8', '1d205164-c89d-4113-baf0-de8905ea1954', '925e6fd8-aee4-4c92-8387-8ea9cf675ef2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Delete snapshot completed successfully. Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec1883d7-d428-4635-bc63-d39f3528a84e tempest-VolumeDependencyTests-321869931 None] Lock "cinder-4e324bda-2395-46ce-b3e4-951d73bc5956-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-4443ae51-7bff-4ae7-b462-5e97443189eb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Lock "cinder-4443ae51-7bff-4ae7-b462-5e97443189eb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-quobyte-4443ae51-7bff-4ae7-b462-5e97443189eb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4443ae51-7bff-4ae7-b462-5e97443189eb" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4120c768-a4f3-4134-b8b1-9ad62fdfcda3]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Flow 'volume_create_manager' (130a7ced-2d8d-4682-884f-4b90e9e87192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6edf01-b613-469e-bd26-c47b298df704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6edf01-b613-469e-bd26-c47b298df704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c531bf-3646-45b3-aeab-72779336efc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98691f0c1c1e42998018b3a7c925142a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:45Z,use_quota=True,user_id='998273877cd54bc09dadf833fbabe9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4734bd-968f-41bc-a10b-aa393a3b9dfc),volume_type_id=ca4734bd-968f-41bc-a10b-aa393a3b9dfc)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c841af8d-3dff-4dcd-a68a-36e99b0a5076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c841af8d-3dff-4dcd-a68a-36e99b0a5076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:44 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb Nov 03 13:12:44 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2453294-159d-4f76-ac83-734078e7f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:44 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:12:45 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2453294-159d-4f76-ac83-734078e7f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12c531bf-3646-45b3-aeab-72779336efc9', 'volume_name': 'volume-12c531bf-3646-45b3-aeab-72779336efc9', 'volume_size': 1, 'image_id': '9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '735f06260d115018b8225c22170e1cd4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98691f0c1c1e42998018b3a7c925142a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d69e87dcdb07814002208c6770ef8b3d926067f11b9403c5acd5e5a1fef902079dafb892e49f746d826aad40d78f3fdd96323d7a2f87e2eec76f6cea21ea9fc', 'id': '9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'created_at': datetime.datetime(2026, 11, 3, 12, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66e2ba5-7ba2-4fe1-80cf-c2b861e6698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66e2ba5-7ba2-4fe1-80cf-c2b861e6698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e78733c-4e94-4881-ac4b-e669656809af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:45 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Volume 12c531bf-3646-45b3-aeab-72779336efc9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12c531bf-3646-45b3-aeab-72779336efc9', 'volume_size': 1, 'image_id': '9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '735f06260d115018b8225c22170e1cd4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98691f0c1c1e42998018b3a7c925142a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d69e87dcdb07814002208c6770ef8b3d926067f11b9403c5acd5e5a1fef902079dafb892e49f746d826aad40d78f3fdd96323d7a2f87e2eec76f6cea21ea9fc', 'id': '9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'created_at': datetime.datetime(2026, 11, 3, 12, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Trying to clone 12c531bf-3646-45b3-aeab-72779336efc9 from image 9cddfd0b-226a-43a8-81d7-e01aeea4835c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:45 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb Nov 03 13:12:45 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:12:45 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac75bd0-16da-4145-9ea3-f9468d816562]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:45 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD Nov 03 13:12:45 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:45 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4443ae51-7bff-4ae7-b462-5e97443189eb" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-4443ae51-7bff-4ae7-b462-5e97443189eb" released by "delete_volume" :: held 0.758s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Created reservations ['713c4cce-30a9-4c32-9712-f81dd35e6172', '9fc70c59-9ba8-40bc-86b0-50be8f377c9a', '4b30e529-041e-4437-a50e-67daf81b6a9f', '0a60904c-2ee3-42e3-ab2a-4b4fda27c53f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:45 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:45 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:45 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:45 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD Nov 03 13:12:45 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-bb83d51c-91fc-4acd-b2d5-c1e3c5742432-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-bb83d51c-91fc-4acd-b2d5-c1e3c5742432-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "cinder-quobyte-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:45 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Deleted volume successfully. Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9377199-613f-46be-975f-9c068eb8c944]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c48ad575-dad3-4fc8-9565-661a7e24ca3a tempest-VolumeDependencyTests-321869931 None] Lock "cinder-4443ae51-7bff-4ae7-b462-5e97443189eb-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:46 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 Nov 03 13:12:46 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:46 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD" returned: 1 in 0.430s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Temporary image 9cddfd0b-226a-43a8-81d7-e01aeea4835c is fetched for user 998273877cd54bc09dadf833fbabe9d5. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb8a6e-5b03-4af3-8b47-d62ee1d9bc6f]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:46 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD Nov 03 13:12:46 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:46 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:46 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432 Nov 03 13:12:46 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:46 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:46 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-quobyte-bb83d51c-91fc-4acd-b2d5-c1e3c5742432" released by "delete_volume" :: held 0.728s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:46 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD Nov 03 13:12:46 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Created reservations ['4165ad26-393b-4b2d-8706-2191169942f9', 'c9e8189b-6e2a-4ef1-8a7f-a51d529fe7dd', '3d8414f8-6281-4567-88cf-a3cd2a5bd773', 'fabd26e7-35ee-408e-8dcd-28e7c3cc09a9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:46 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:46 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:46 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c531bf-3646-45b3-aeab-72779336efc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98691f0c1c1e42998018b3a7c925142a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:45Z,use_quota=True,user_id='998273877cd54bc09dadf833fbabe9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4734bd-968f-41bc-a10b-aa393a3b9dfc),volume_type_id=ca4734bd-968f-41bc-a10b-aa393a3b9dfc)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Creating volume 12c531bf-3646-45b3-aeab-72779336efc9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:46 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:46 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 1073741824 Nov 03 13:12:46 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:47 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Deleted volume successfully. Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90a53e5a-2a32-45b8-89a2-40d9a0527615 tempest-VolumeDependencyTests-321869931 None] Lock "cinder-bb83d51c-91fc-4acd-b2d5-c1e3c5742432-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:47 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 1073741824" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:47 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 Nov 03 13:12:47 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:47 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Attempting download of 9cddfd0b-226a-43a8-81d7-e01aeea4835c ((None, [{'url': 'file:///opt/stack/data/glance/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'metadata': {}}])) to volume 12c531bf-3646-45b3-aeab-72779336efc9. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f8e153-5f73-4130-a8c9-5f8118af738a]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cddfd0b-226a-43a8-81d7-e01aeea4835c_djgmmkys {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:47 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cddfd0b-226a-43a8-81d7-e01aeea4835c_djgmmkys Nov 03 13:12:47 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:48 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cddfd0b-226a-43a8-81d7-e01aeea4835c_djgmmkys" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cddfd0b-226a-43a8-81d7-e01aeea4835c_djgmmkys {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:48 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cddfd0b-226a-43a8-81d7-e01aeea4835c_djgmmkys Nov 03 13:12:48 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:48 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cddfd0b-226a-43a8-81d7-e01aeea4835c_djgmmkys" returned: 1 in 0.341s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cddfd0b-226a-43a8-81d7-e01aeea4835c_djgmmkys' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa9e30a-a7f7-42e2-ad31-7cf2953d2bca]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:48 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD Nov 03 13:12:48 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:48 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:48 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD Nov 03 13:12:48 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:49 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:12:49 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] 9cddfd0b-226a-43a8-81d7-e01aeea4835c was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:12:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:49 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 Nov 03 13:12:49 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:49 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9" returned: 0 in 0.494s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:49 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9cddfd0b-226a-43a8-81d7-e01aeea4835c_ydzz64bbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:12:49 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:12:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:49 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 1G Nov 03 13:12:49 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:50 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 1G" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Downloaded image 9cddfd0b-226a-43a8-81d7-e01aeea4835c ((None, [{'url': 'file:///opt/stack/data/glance/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'metadata': {}}])) to volume 12c531bf-3646-45b3-aeab-72779336efc9 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Temporary image 9cddfd0b-226a-43a8-81d7-e01aeea4835c for user 998273877cd54bc09dadf833fbabe9d5 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Marking volume 12c531bf-3646-45b3-aeab-72779336efc9 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Copying metadata from image 9cddfd0b-226a-43a8-81d7-e01aeea4835c to 12c531bf-3646-45b3-aeab-72779336efc9. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Creating volume glance metadata for volume 12c531bf-3646-45b3-aeab-72779336efc9 backed by image 9cddfd0b-226a-43a8-81d7-e01aeea4835c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '735f06260d115018b8225c22170e1cd4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e78733c-4e94-4881-ac4b-e669656809af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c531bf-3646-45b3-aeab-72779336efc9', 'volume_size': 1, 'image_id': '9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '735f06260d115018b8225c22170e1cd4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98691f0c1c1e42998018b3a7c925142a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d69e87dcdb07814002208c6770ef8b3d926067f11b9403c5acd5e5a1fef902079dafb892e49f746d826aad40d78f3fdd96323d7a2f87e2eec76f6cea21ea9fc', 'id': '9cddfd0b-226a-43a8-81d7-e01aeea4835c', 'created_at': datetime.datetime(2026, 11, 3, 12, 12, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 12, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cddfd0b-226a-43a8-81d7-e01aeea4835c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7f41b4-b911-4867-9a64-048c9cf5b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Volume volume-12c531bf-3646-45b3-aeab-72779336efc9 (12c531bf-3646-45b3-aeab-72779336efc9): created successfully Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7f41b4-b911-4867-9a64-048c9cf5b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Flow 'volume_create_manager' (130a7ced-2d8d-4682-884f-4b90e9e87192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3655e99b-05c5-4426-a916-db7481fc988d tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Created volume successfully. Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Acquiring lock "cinder-12c531bf-3646-45b3-aeab-72779336efc9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "cinder-12c531bf-3646-45b3-aeab-72779336efc9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Acquiring lock "cinder-quobyte-12c531bf-3646-45b3-aeab-72779336efc9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "cinder-quobyte-12c531bf-3646-45b3-aeab-72779336efc9" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a19bd3c-d870-4c6d-977a-36db46378574]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:51 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 Nov 03 13:12:51 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:51 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:51 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9 Nov 03 13:12:51 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:51 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-12c531bf-3646-45b3-aeab-72779336efc9" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "cinder-quobyte-12c531bf-3646-45b3-aeab-72779336efc9" released by "delete_volume" :: held 0.700s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:52 devstack cinder-volume[86369]: WARNING cinder.quota [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:12:52 devstack cinder-volume[86369]: WARNING cinder.quota [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Created reservations ['b657ef2f-f945-4e88-9889-6737c3a0ed40', 'bfc5cb52-f113-4d8a-be51-5441d19636d4', '0c5302da-2bc8-4eb4-ac9c-e34ee89ae725', 'f8034255-da61-4e0d-83b9-70372767f7b0'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:52 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:52 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:52 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Deleted volume successfully. Nov 03 13:12:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb12eb70-4621-4776-9548-30937281a22e tempest-VolumeAndVolumeTypeFromImageTest-1576250892 None] Lock "cinder-12c531bf-3646-45b3-aeab-72779336efc9-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (02ec7df9-344c-45ca-bfe0-c0f6ac5ee55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fe0c77-0b4e-47b1-ad41-31b11c07e91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fe0c77-0b4e-47b1-ad41-31b11c07e91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230688085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8432e1-2b11-481c-981b-f6caba922cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:56Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b576ed70-500f-4f00-895c-f2003624d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b576ed70-500f-4f00-895c-f2003624d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78c38b1-b239-4cff-b163-f2d02d705f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78c38b1-b239-4cff-b163-f2d02d705f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8432e1-2b11-481c-981b-f6caba922cb9', 'volume_name': 'volume-1e8432e1-2b11-481c-981b-f6caba922cb9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b937d8ea-d082-4608-8764-ace6b8208695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b937d8ea-d082-4608-8764-ace6b8208695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248836f2-9950-44eb-a59d-a65d1e0014a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Volume 1e8432e1-2b11-481c-981b-f6caba922cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8432e1-2b11-481c-981b-f6caba922cb9', 'volume_size': 1} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230688085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8432e1-2b11-481c-981b-f6caba922cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:12:56Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Creating volume 1e8432e1-2b11-481c-981b-f6caba922cb9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:55 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:55 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 1073741824 Nov 03 13:12:55 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:56 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 1073741824" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:56 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 Nov 03 13:12:56 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:56 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248836f2-9950-44eb-a59d-a65d1e0014a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8432e1-2b11-481c-981b-f6caba922cb9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdd876e-2095-42df-85df-ceca62890e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Volume volume-1e8432e1-2b11-481c-981b-f6caba922cb9 (1e8432e1-2b11-481c-981b-f6caba922cb9): created successfully Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdd876e-2095-42df-85df-ceca62890e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (02ec7df9-344c-45ca-bfe0-c0f6ac5ee55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-592a08ed-032c-48e5-acbd-0441bc5dfec8 tempest-ProjectReaderTests-1033559401 None] Created volume successfully. Nov 03 13:12:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-1e8432e1-2b11-481c-981b-f6caba922cb9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Lock "cinder-1e8432e1-2b11-481c-981b-f6caba922cb9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-quobyte-1e8432e1-2b11-481c-981b-f6caba922cb9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-1e8432e1-2b11-481c-981b-f6caba922cb9" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0913b904-cd05-42e5-91a9-102eff46475f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:58 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 Nov 03 13:12:58 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:58 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:58 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9 Nov 03 13:12:58 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:58 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1e8432e1-2b11-481c-981b-f6caba922cb9" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-1e8432e1-2b11-481c-981b-f6caba922cb9" released by "delete_volume" :: held 0.656s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Created reservations ['46497f31-f04e-4d88-814d-9b7af8934c3a', '1292c371-4804-4ecc-82cf-eb0000896c26', '28fd6fb7-e2cf-475a-88a0-74fac530959f', '3dfdb33e-3ab4-46d8-9ce9-bfc8b7adbf2c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:12:58 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:58 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:58 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:12:58 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:12:58 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:12:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:12:59 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:12:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Deleted volume successfully. Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d1c0ce4a-63fb-4e45-8d8a-eb354b42fc90 tempest-ProjectReaderTests-1033559401 None] Lock "cinder-1e8432e1-2b11-481c-981b-f6caba922cb9-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (51065b6e-ce44-43b7-b550-47f0201323cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a49a282-c175-4710-b1eb-fe072c9244fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a49a282-c175-4710-b1eb-fe072c9244fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615971454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4501c5-d583-4a0e-bdc9-fa74c03cad29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:00Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffef9f2c-b300-4d61-a751-74318c750270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffef9f2c-b300-4d61-a751-74318c750270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088d435d-1344-430b-afca-f2954a4147cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088d435d-1344-430b-afca-f2954a4147cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4501c5-d583-4a0e-bdc9-fa74c03cad29', 'volume_name': 'volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a45345-0e2e-49f3-8032-ca605d410db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a45345-0e2e-49f3-8032-ca605d410db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f33989d-c277-4f83-9dda-c67c3498c09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:12:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Volume ae4501c5-d583-4a0e-bdc9-fa74c03cad29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29', 'volume_size': 1} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615971454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4501c5-d583-4a0e-bdc9-fa74c03cad29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:00Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Creating volume ae4501c5-d583-4a0e-bdc9-fa74c03cad29 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:12:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:12:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:12:59 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 1073741824 Nov 03 13:12:59 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:00 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 1073741824" returned: 0 in 0.409s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:00 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 Nov 03 13:13:00 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:00 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29" returned: 0 in 0.245s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f33989d-c277-4f83-9dda-c67c3498c09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7182f3-3e46-48c4-ab55-7ad4b055de4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Volume volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 (ae4501c5-d583-4a0e-bdc9-fa74c03cad29): created successfully Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7182f3-3e46-48c4-ab55-7ad4b055de4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (51065b6e-ce44-43b7-b550-47f0201323cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e57baeb1-5064-4d7d-ae33-a515ba61fca7 tempest-ProjectReaderTests-1033559401 None] Created volume successfully. Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-ae4501c5-d583-4a0e-bdc9-fa74c03cad29-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Lock "cinder-ae4501c5-d583-4a0e-bdc9-fa74c03cad29-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-quobyte-ae4501c5-d583-4a0e-bdc9-fa74c03cad29" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-ae4501c5-d583-4a0e-bdc9-fa74c03cad29" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab5780-b77d-4fdf-a35f-555aa619b4dd]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:00 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 Nov 03 13:13:00 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:01 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:01 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29 Nov 03 13:13:01 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:01 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ae4501c5-d583-4a0e-bdc9-fa74c03cad29" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-ae4501c5-d583-4a0e-bdc9-fa74c03cad29" released by "delete_volume" :: held 0.663s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Created reservations ['d4430ac8-2e0b-4f00-a384-e9afe89dc260', '7ec3a0e6-579c-490b-b8a4-09a24915cd37', '85a5f37c-228d-4f4a-885b-604b21043f8f', '33cf862d-5a4a-4002-9a09-0bd95cf6091f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:01 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:01 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:01 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.242s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Deleted volume successfully. Nov 03 13:13:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1e694901-9a6a-448e-ad0d-df378c28d21e tempest-ProjectReaderTests-1033559401 None] Lock "cinder-ae4501c5-d583-4a0e-bdc9-fa74c03cad29-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (1f100f70-e5f4-4ca5-a4d1-7a01d9edc58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6dbd0f-5cd6-4934-ac69-da9fcb8da483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6dbd0f-5cd6-4934-ac69-da9fcb8da483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605531998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2d13a6-8ebf-46f6-bec7-17bd198da056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:02Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e6b0e3-2cef-4c11-9c36-0b795897eaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e6b0e3-2cef-4c11-9c36-0b795897eaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57075958-7e77-4792-8785-13b3a9926dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57075958-7e77-4792-8785-13b3a9926dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2d13a6-8ebf-46f6-bec7-17bd198da056', 'volume_name': 'volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9289dd7c-2ce1-44d9-8bc9-5520048c0395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9289dd7c-2ce1-44d9-8bc9-5520048c0395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7f9ce4-b43b-493a-b8e9-872dc192150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Volume ab2d13a6-8ebf-46f6-bec7-17bd198da056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056', 'volume_size': 1} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605531998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2d13a6-8ebf-46f6-bec7-17bd198da056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:02Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Creating volume ab2d13a6-8ebf-46f6-bec7-17bd198da056 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:02 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:02 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 1073741824 Nov 03 13:13:02 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:02 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 1073741824" returned: 0 in 0.414s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=139,cinder:SELECT=108,cinder:INSERT=38,cinder:DELETE=16 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=112,cinder:UPDATE=152,cinder:DELETE=9,cinder:INSERT=41 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:13:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:02 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 Nov 03 13:13:02 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:03 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7f9ce4-b43b-493a-b8e9-872dc192150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7898213-c3bf-429c-8952-ee6021621bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Volume volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 (ab2d13a6-8ebf-46f6-bec7-17bd198da056): created successfully Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7898213-c3bf-429c-8952-ee6021621bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (1f100f70-e5f4-4ca5-a4d1-7a01d9edc58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5b476878-7967-4c96-886f-0a81a04da295 tempest-ProjectReaderTests-1033559401 None] Created volume successfully. Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-ab2d13a6-8ebf-46f6-bec7-17bd198da056-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Lock "cinder-ab2d13a6-8ebf-46f6-bec7-17bd198da056-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-quobyte-ab2d13a6-8ebf-46f6-bec7-17bd198da056" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-ab2d13a6-8ebf-46f6-bec7-17bd198da056" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[82959faf-9b94-434d-a04f-f8dae5d7515a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:03 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 Nov 03 13:13:03 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:03 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:03 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056 Nov 03 13:13:03 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:03 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-ab2d13a6-8ebf-46f6-bec7-17bd198da056" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-ab2d13a6-8ebf-46f6-bec7-17bd198da056" released by "delete_volume" :: held 0.654s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Created reservations ['791b8c36-4e76-4def-bf75-04c00a70d035', '0f6dabef-e44a-4e42-bd09-ae1e0ba01b93', '84af6d80-6d6b-4d06-a199-7e0a7a6c2634', 'c0c168b1-d1df-4d44-a15e-5c5544ee0c84'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:04 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:04 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:04 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.244s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Deleted volume successfully. Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-34660add-96fd-4cb6-9181-c58617fddcbf tempest-ProjectReaderTests-1033559401 None] Lock "cinder-ab2d13a6-8ebf-46f6-bec7-17bd198da056-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (b8d839e8-84d7-4e59-b7de-6cda98bbefb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009452a4-801b-49cf-ab38-e7ccf89f3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009452a4-801b-49cf-ab38-e7ccf89f3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474182164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97e6284-f0d7-464d-b248-2c5cf1b7a9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:05Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a57ccb-8f8b-4220-9046-705e0b511b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a57ccb-8f8b-4220-9046-705e0b511b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a78f7c-1312-432e-9db4-576016b70a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a78f7c-1312-432e-9db4-576016b70a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97e6284-f0d7-464d-b248-2c5cf1b7a9cd', 'volume_name': 'volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e7d464-16a3-46a9-ac25-1c697896cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e7d464-16a3-46a9-ac25-1c697896cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae0eb3d-2101-490e-9e03-eca133ef137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Volume d97e6284-f0d7-464d-b248-2c5cf1b7a9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd', 'volume_size': 1} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474182164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97e6284-f0d7-464d-b248-2c5cf1b7a9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10557eac24df495a8a43b32173fba0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:05Z,use_quota=True,user_id='6a7cd8b24c5d4e82b751641dc3f0a046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Creating volume d97e6284-f0d7-464d-b248-2c5cf1b7a9cd {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:05 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd 1073741824 Nov 03 13:13:05 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:05 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd 1073741824" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:05 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd Nov 03 13:13:05 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:05 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd" returned: 0 in 0.246s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae0eb3d-2101-490e-9e03-eca133ef137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bb24ee-f444-48bb-97ca-0cbf8b65240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Volume volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd (d97e6284-f0d7-464d-b248-2c5cf1b7a9cd): created successfully Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bb24ee-f444-48bb-97ca-0cbf8b65240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Flow 'volume_create_manager' (b8d839e8-84d7-4e59-b7de-6cda98bbefb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c7be2854-b55f-4bb3-8557-d41d39532952 tempest-ProjectReaderTests-1033559401 None] Created volume successfully. Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Lock "cinder-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Acquiring lock "cinder-quobyte-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1f10f0-bddc-4961-bd64-90af8a43d6d4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:06 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd Nov 03 13:13:06 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:06 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd" returned: 0 in 0.367s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:06 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd Nov 03 13:13:06 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:06 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd" returned: 0 in 0.261s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Lock "cinder-quobyte-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd" released by "delete_volume" :: held 0.668s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Created reservations ['fe8e7492-7293-4af9-b50b-33287bbb02f8', '8535bd2d-98ae-4558-811a-c20e54baac31', 'b75f58df-3f5a-4217-8b12-2807593d1cf6', '5a28c98e-d98c-493d-b5a3-a1e6ed968f48'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:06 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:06 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:07 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Deleted volume successfully. Nov 03 13:13:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e0eb1a6-fc75-4333-b5df-6079f1e6867d tempest-ProjectReaderTests-1033559401 None] Lock "cinder-d97e6284-f0d7-464d-b248-2c5cf1b7a9cd-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:16 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:13:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=19,cinder:DELETE=2,cinder:SELECT=12,cinder:INSERT=3 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (2e346fd8-e9c1-4bb6-a04b-db6174720b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30059286-57cc-4d1c-89e2-8b56c271eefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30059286-57cc-4d1c-89e2-8b56c271eefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375344944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa94b53b-b571-41aa-b146-4b3915a6540c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:19Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad4a647-7fa9-44dc-84c6-e43faddc8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad4a647-7fa9-44dc-84c6-e43faddc8893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3ff61b-31cc-4e58-b2ee-c6991ff2e43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3ff61b-31cc-4e58-b2ee-c6991ff2e43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa94b53b-b571-41aa-b146-4b3915a6540c', 'volume_name': 'volume-aa94b53b-b571-41aa-b146-4b3915a6540c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76afc6a6-baca-4780-b6d4-7b283fbd5007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76afc6a6-baca-4780-b6d4-7b283fbd5007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2df6596-9849-4806-886c-c89a37ed4524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Volume aa94b53b-b571-41aa-b146-4b3915a6540c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa94b53b-b571-41aa-b146-4b3915a6540c', 'volume_size': 1} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375344944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa94b53b-b571-41aa-b146-4b3915a6540c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:19Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Creating volume aa94b53b-b571-41aa-b146-4b3915a6540c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:19 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c 1073741824 Nov 03 13:13:19 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (a8e32143-2441-4276-b732-76e1ea064fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865e3c09-3152-422a-86b2-7bf903281555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865e3c09-3152-422a-86b2-7bf903281555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-308667295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02dd4c5-1418-4c28-95cb-40f1a135320f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:19Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ad84f9-b5a8-40e9-aa9a-6cbae0f5f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ad84f9-b5a8-40e9-aa9a-6cbae0f5f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef230f9-5313-4ed9-b7d7-7cc1b8f1807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef230f9-5313-4ed9-b7d7-7cc1b8f1807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02dd4c5-1418-4c28-95cb-40f1a135320f', 'volume_name': 'volume-f02dd4c5-1418-4c28-95cb-40f1a135320f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2d1368-c871-4339-a182-51027ac1ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2d1368-c871-4339-a182-51027ac1ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde35508-0da2-457f-a0ec-a83a025c4492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume f02dd4c5-1418-4c28-95cb-40f1a135320f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02dd4c5-1418-4c28-95cb-40f1a135320f', 'volume_size': 1} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (166d35e4-ec7d-4dcd-b990-409957da253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5c4189-b86c-4613-a255-5f31aefc715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5c4189-b86c-4613-a255-5f31aefc715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-493973241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1f1c42-7215-4bf0-ade3-b1822c93db0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:20Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ada2b4-304a-4995-9e1c-424c4717d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ada2b4-304a-4995-9e1c-424c4717d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69665c42-57a0-4a9a-83d4-d735046f50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69665c42-57a0-4a9a-83d4-d735046f50bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1f1c42-7215-4bf0-ade3-b1822c93db0d', 'volume_name': 'volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac3e66d-8fc4-4674-b068-50b3ab027d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac3e66d-8fc4-4674-b068-50b3ab027d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b33466-c8d8-458e-9e78-49bea65e3157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Volume fc1f1c42-7215-4bf0-ade3-b1822c93db0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d', 'volume_size': 1} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (a39347ab-1450-4e74-b20c-c0dee4b64a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d60e51-3da7-4d93-8b99-962a63c25298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d60e51-3da7-4d93-8b99-962a63c25298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1956154474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1470246e-5358-4ad9-8974-d66ee625a448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:20Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba4ab27-38b6-4d49-9d7a-8c8436a71f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba4ab27-38b6-4d49-9d7a-8c8436a71f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade04748-f152-4c7b-8872-d7b4ca559c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade04748-f152-4c7b-8872-d7b4ca559c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1470246e-5358-4ad9-8974-d66ee625a448', 'volume_name': 'volume-1470246e-5358-4ad9-8974-d66ee625a448', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528ffad9-96cc-41bc-9d56-d5c9c41173db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528ffad9-96cc-41bc-9d56-d5c9c41173db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36548afe-ebf8-41d2-9538-eb6fb96de91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume 1470246e-5358-4ad9-8974-d66ee625a448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1470246e-5358-4ad9-8974-d66ee625a448', 'volume_size': 1} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:20 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c 1073741824" returned: 0 in 0.741s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:20 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c Nov 03 13:13:20 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (0f051ed4-768a-467e-8dca-880adec9ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd3a4d9-3448-43cd-bdcb-7d60ae2a7d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd3a4d9-3448-43cd-bdcb-7d60ae2a7d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1071747003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0872844c-6d46-44c4-970f-071423c06af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:20Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0099950a-ed99-4e0a-a245-4c66996c6b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0099950a-ed99-4e0a-a245-4c66996c6b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82ceb4c-5f1c-421d-8038-32747cfe9663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82ceb4c-5f1c-421d-8038-32747cfe9663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0872844c-6d46-44c4-970f-071423c06af6', 'volume_name': 'volume-0872844c-6d46-44c4-970f-071423c06af6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36cf87-4bca-4ec3-9c66-493f1eae05e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36cf87-4bca-4ec3-9c66-493f1eae05e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d26bd8-7b6e-4c87-ab98-0619b31724b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Volume 0872844c-6d46-44c4-970f-071423c06af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0872844c-6d46-44c4-970f-071423c06af6', 'volume_size': 1} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:20 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c" returned: 0 in 0.375s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-308667295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02dd4c5-1418-4c28-95cb-40f1a135320f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:19Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Creating volume f02dd4c5-1418-4c28-95cb-40f1a135320f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:20 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f 1073741824 Nov 03 13:13:20 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2df6596-9849-4806-886c-c89a37ed4524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa94b53b-b571-41aa-b146-4b3915a6540c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d6833-6e6f-4780-b2d7-b057c1fe8ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (fdc47fdd-18e8-4cca-8710-fbb4077d52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9bd55f-a688-4601-a913-66b7605be339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Volume volume-aa94b53b-b571-41aa-b146-4b3915a6540c (aa94b53b-b571-41aa-b146-4b3915a6540c): created successfully Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d6833-6e6f-4780-b2d7-b057c1fe8ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (2e346fd8-e9c1-4bb6-a04b-db6174720b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9bd55f-a688-4601-a913-66b7605be339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560751918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:21Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eff294-ac67-4b9d-9deb-adf1cf9abe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eff294-ac67-4b9d-9deb-adf1cf9abe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f041d13-30c4-4610-abc2-648f6f66d2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f041d13-30c4-4610-abc2-648f6f66d2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17', 'volume_name': 'volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d269a6-d8ab-4d4c-95b1-4c658c9cca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d269a6-d8ab-4d4c-95b1-4c658c9cca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66f747b-790b-43b8-9828-b6a620c810cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Volume a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17', 'volume_size': 1} Nov 03 13:13:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5a03a645-cd67-4ae1-b5df-7e9390fc0a54 tempest-CreateVolumesFromImageTest-507282031 None] Created volume successfully. Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (cba3f63d-7af5-4680-a2d7-80375479d240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1626d07f-75f3-48b8-aaf4-1b29f5193543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1626d07f-75f3-48b8-aaf4-1b29f5193543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392716390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6757f1c0-385c-48e9-816a-23579fdd02b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:21Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4590c570-b057-4100-93b0-2c155954948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4590c570-b057-4100-93b0-2c155954948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e76d048-933b-4bea-9f6d-d5c65f7d0a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e76d048-933b-4bea-9f6d-d5c65f7d0a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6757f1c0-385c-48e9-816a-23579fdd02b4', 'volume_name': 'volume-6757f1c0-385c-48e9-816a-23579fdd02b4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8eb6bc-aa80-4afa-846d-16648544247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8eb6bc-aa80-4afa-846d-16648544247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d870add-b900-4373-a3b4-8797afc7d5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Volume 6757f1c0-385c-48e9-816a-23579fdd02b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6757f1c0-385c-48e9-816a-23579fdd02b4', 'volume_size': 1} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:21 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f 1073741824" returned: 0 in 0.623s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:21 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f Nov 03 13:13:21 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:21 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-493973241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1f1c42-7215-4bf0-ade3-b1822c93db0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:20Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Creating volume fc1f1c42-7215-4bf0-ade3-b1822c93db0d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:21 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:21 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d 1073741824 Nov 03 13:13:21 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde35508-0da2-457f-a0ec-a83a025c4492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02dd4c5-1418-4c28-95cb-40f1a135320f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1fb960-340d-43e5-b874-6f63ea5c3a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume volume-f02dd4c5-1418-4c28-95cb-40f1a135320f (f02dd4c5-1418-4c28-95cb-40f1a135320f): created successfully Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1fb960-340d-43e5-b874-6f63ea5c3a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (a8e32143-2441-4276-b732-76e1ea064fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-98b7d80b-6676-4537-a061-877ceebd5b67 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created volume successfully. Nov 03 13:13:22 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d 1073741824" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:22 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d Nov 03 13:13:22 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:22 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.388s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1956154474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1470246e-5358-4ad9-8974-d66ee625a448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:20Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Creating volume 1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b33466-c8d8-458e-9e78-49bea65e3157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:22 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 1073741824 Nov 03 13:13:22 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998195d0-4dce-4179-808a-b7585cd23174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Volume volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d (fc1f1c42-7215-4bf0-ade3-b1822c93db0d): created successfully Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998195d0-4dce-4179-808a-b7585cd23174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (166d35e4-ec7d-4dcd-b990-409957da253f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4cfe0bc1-fcad-49d3-9e02-eaf1f3b9df3e tempest-CreateVolumesFromImageTest-507282031 None] Created volume successfully. Nov 03 13:13:22 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 1073741824" returned: 0 in 0.457s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:23 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 Nov 03 13:13:23 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:23 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.735s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1071747003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0872844c-6d46-44c4-970f-071423c06af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:20Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Creating volume 0872844c-6d46-44c4-970f-071423c06af6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:23 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36548afe-ebf8-41d2-9538-eb6fb96de91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1470246e-5358-4ad9-8974-d66ee625a448', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3351af-969e-4f1c-a29c-fa4fe6887fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 1073741824 Nov 03 13:13:23 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume volume-1470246e-5358-4ad9-8974-d66ee625a448 (1470246e-5358-4ad9-8974-d66ee625a448): created successfully Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3351af-969e-4f1c-a29c-fa4fe6887fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (a39347ab-1450-4e74-b20c-c0dee4b64a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-795a945d-bfeb-4ca3-8397-5d82eec81aa2 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created volume successfully. Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (9221694c-dd5e-43db-8f97-5d23b9ca9083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392d604c-c208-4138-8e59-f50fa8f656b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392d604c-c208-4138-8e59-f50fa8f656b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1415228505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0442dc64-87f0-4bb0-9786-cfe8510e62e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b463b95e-8fef-4819-a3fa-8da89d4d4015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b463b95e-8fef-4819-a3fa-8da89d4d4015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00465d65-dcac-40b2-a2fc-4c017b4e5826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00465d65-dcac-40b2-a2fc-4c017b4e5826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0442dc64-87f0-4bb0-9786-cfe8510e62e1', 'volume_name': 'volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c177e2-9abb-4de4-8b2c-29e935304830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c177e2-9abb-4de4-8b2c-29e935304830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9a4659-a1f3-46f9-98c4-eeae38a8df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume 0442dc64-87f0-4bb0-9786-cfe8510e62e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1', 'volume_size': 1} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Flow 'volume_create_manager' (fc8ce8f1-3fdf-4854-9748-7e2414921514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a589fe-3fa6-4a52-b449-3ea16428c288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a589fe-3fa6-4a52-b449-3ea16428c288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f90079c9ff4a6abfe2910cf84c8dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='ce703205665a43458745ecdce70b6101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa4357d1-9159-4007-860f-5a0ecaf5d4d5),volume_type_id=fa4357d1-9159-4007-860f-5a0ecaf5d4d5)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a9e955-c9d4-41c3-bc79-bffd32f1d14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a9e955-c9d4-41c3-bc79-bffd32f1d14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc82fcb7-1be9-4e53-a37b-ad15dee0d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 1073741824" returned: 0 in 0.642s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:24 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 Nov 03 13:13:24 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (c54259ad-308b-4543-9b4f-b611438a2e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29691eb-b4f0-45c5-8d20-d5fc2b1c2015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29691eb-b4f0-45c5-8d20-d5fc2b1c2015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962253049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07760e21-c852-4ba9-908c-e1317837fa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70d07ee-fb9b-4371-9084-1017d09f0aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70d07ee-fb9b-4371-9084-1017d09f0aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7be1e0-fd77-42a5-8436-1d88cdbd0fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7be1e0-fd77-42a5-8436-1d88cdbd0fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07760e21-c852-4ba9-908c-e1317837fa89', 'volume_name': 'volume-07760e21-c852-4ba9-908c-e1317837fa89', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd44a164-04fc-4486-87fb-2f0f62b09187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd44a164-04fc-4486-87fb-2f0f62b09187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1f39c9-c5f1-420a-bc20-81ab2fee0045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume 07760e21-c852-4ba9-908c-e1317837fa89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07760e21-c852-4ba9-908c-e1317837fa89', 'volume_size': 1} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6" returned: 0 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.362s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560751918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:21Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Creating volume a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:24 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc82fcb7-1be9-4e53-a37b-ad15dee0d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df', 'volume_name': 'volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df', 'volume_size': 1, 'image_id': '761b6e2e-3603-4d56-9f36-2060cf2befb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/761b6e2e-3603-4d56-9f36-2060cf2befb3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75fab8d13de7a417fb56cc1f87b9d69a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91f90079c9ff4a6abfe2910cf84c8dcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '443c7e1881dd3631fd358cb70511269f7d470891864e2fce0cf2c2650194772bf393ba8bb1ff114c81aa026925a36856e4bd0dcca5be7660e5598b8bef67cd84', 'id': '761b6e2e-3603-4d56-9f36-2060cf2befb3', 'created_at': datetime.datetime(2026, 11, 3, 12, 13, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 13, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/761b6e2e-3603-4d56-9f36-2060cf2befb3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930985cf-4ee9-4ffc-90a8-be63691b3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930985cf-4ee9-4ffc-90a8-be63691b3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 1073741824 Nov 03 13:13:24 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d8e7aa-0977-4f97-9215-f1d8a51185ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Volume 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df', 'volume_size': 1, 'image_id': '761b6e2e-3603-4d56-9f36-2060cf2befb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/761b6e2e-3603-4d56-9f36-2060cf2befb3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75fab8d13de7a417fb56cc1f87b9d69a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91f90079c9ff4a6abfe2910cf84c8dcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '443c7e1881dd3631fd358cb70511269f7d470891864e2fce0cf2c2650194772bf393ba8bb1ff114c81aa026925a36856e4bd0dcca5be7660e5598b8bef67cd84', 'id': '761b6e2e-3603-4d56-9f36-2060cf2befb3', 'created_at': datetime.datetime(2026, 11, 3, 12, 13, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 13, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/761b6e2e-3603-4d56-9f36-2060cf2befb3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Trying to clone 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df from image 761b6e2e-3603-4d56-9f36-2060cf2befb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/761b6e2e-3603-4d56-9f36-2060cf2befb3', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d26bd8-7b6e-4c87-ab98-0619b31724b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0872844c-6d46-44c4-970f-071423c06af6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba8a959-9a8c-4e73-b505-2080cdf8e0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Volume volume-0872844c-6d46-44c4-970f-071423c06af6 (0872844c-6d46-44c4-970f-071423c06af6): created successfully Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba8a959-9a8c-4e73-b505-2080cdf8e0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (0f051ed4-768a-467e-8dca-880adec9ff51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e8bb569a-52cd-4f0e-8464-8ae9e0cb5c88 tempest-CreateVolumesFromImageTest-507282031 None] Created volume successfully. Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:13:24 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e780f3-ca1f-46f9-ba5f-490197836c27]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (ca6a4fcd-88e6-4ff5-ba81-aba77e53deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d7bb50-587b-41bd-95cf-0dafa92f0143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d7bb50-587b-41bd-95cf-0dafa92f0143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17010654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:25Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebe8b03-da19-4d06-96f6-3a03629120ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebe8b03-da19-4d06-96f6-3a03629120ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acf9227-1761-41a1-b18e-f7e6eab2685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acf9227-1761-41a1-b18e-f7e6eab2685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb', 'volume_name': 'volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d211203-9fdd-49b9-acc6-863acf74f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d211203-9fdd-49b9-acc6-863acf74f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2445f321-5b11-4953-b5a9-b2b646a87b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume 8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb', 'volume_size': 1} Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:24 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD Nov 03 13:13:24 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:24 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 1073741824" returned: 0 in 0.643s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:25 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 Nov 03 13:13:25 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:25 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD" returned: 0 in 0.535s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:25 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD Nov 03 13:13:25 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:25 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (dfe46349-e686-43da-8bf7-8880a1795c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7068c4-571e-4501-9282-1f9792f753d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.056s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392716390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6757f1c0-385c-48e9-816a-23579fdd02b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4bc867acf84d469e4543345ed11748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:21Z,use_quota=True,user_id='bbf450a871954e0e99d1679db4af4135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Creating volume 6757f1c0-385c-48e9-816a-23579fdd02b4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:25 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7068c4-571e-4501-9282-1f9792f753d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1223629790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1492fe0-f2ec-41ee-be56-251355c43848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:25Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411fd436-531f-45e1-9b7f-c16bf6f41033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411fd436-531f-45e1-9b7f-c16bf6f41033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af3c639-00f8-466d-89c3-79cd3302cd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 1073741824 Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af3c639-00f8-466d-89c3-79cd3302cd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1492fe0-f2ec-41ee-be56-251355c43848', 'volume_name': 'volume-d1492fe0-f2ec-41ee-be56-251355c43848', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d036bc0-4b96-40df-8eb7-bc241968a486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d036bc0-4b96-40df-8eb7-bc241968a486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f92df33-b91b-4ef8-854a-57bc6dd96ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume d1492fe0-f2ec-41ee-be56-251355c43848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1492fe0-f2ec-41ee-be56-251355c43848', 'volume_size': 1} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66f747b-790b-43b8-9828-b6a620c810cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3685cc42-5b0b-4485-84e3-5161b738ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Volume volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 (a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17): created successfully Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3685cc42-5b0b-4485-84e3-5161b738ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (fdc47fdd-18e8-4cca-8710-fbb4077d52fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Temporary image 761b6e2e-3603-4d56-9f36-2060cf2befb3 is fetched for user ce703205665a43458745ecdce70b6101. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:13:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3ea9e3a9-67e6-40af-b6ed-149e1d49a165 tempest-CreateVolumesFromImageTest-507282031 None] Created volume successfully. Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da6ec77-6dc3-42ec-bcfb-a14ed25cc0df]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (1d17560d-544f-4e12-92e0-834530954431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:25 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD Nov 03 13:13:25 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee1eff9-b0ac-4944-a553-5ef9aadcf305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee1eff9-b0ac-4944-a553-5ef9aadcf305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369748161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12c8969-c972-46d3-a7ab-47833383a908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:26Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f95c24a-223d-4707-bef7-412962cec230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f95c24a-223d-4707-bef7-412962cec230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a98009-c6bc-469f-b61a-0c0b4c99ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a98009-c6bc-469f-b61a-0c0b4c99ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12c8969-c972-46d3-a7ab-47833383a908', 'volume_name': 'volume-f12c8969-c972-46d3-a7ab-47833383a908', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f120bec-fdc2-4c0b-b5e2-40ec7828b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f120bec-fdc2-4c0b-b5e2-40ec7828b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a145f65d-a6fb-4abb-9eaf-b395992e8beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume f12c8969-c972-46d3-a7ab-47833383a908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12c8969-c972-46d3-a7ab-47833383a908', 'volume_size': 1} Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:25 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 1073741824" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:26 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 Nov 03 13:13:26 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:26 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:26 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD Nov 03 13:13:26 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:26 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.524s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1415228505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0442dc64-87f0-4bb0-9786-cfe8510e62e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Creating volume 0442dc64-87f0-4bb0-9786-cfe8510e62e1 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:26 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d870add-b900-4373-a3b4-8797afc7d5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6757f1c0-385c-48e9-816a-23579fdd02b4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1466cc39-f264-47af-b0fd-d93d1171a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:26 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 1073741824 Nov 03 13:13:26 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Volume volume-6757f1c0-385c-48e9-816a-23579fdd02b4 (6757f1c0-385c-48e9-816a-23579fdd02b4): created successfully Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1466cc39-f264-47af-b0fd-d93d1171a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Flow 'volume_create_manager' (cba3f63d-7af5-4680-a2d7-80375479d240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7770552f-aa1f-43dc-9344-999af50a6359 tempest-CreateVolumesFromImageTest-507282031 None] Created volume successfully. Nov 03 13:13:26 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD" returned: 1 in 0.353s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:26 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 1073741824" returned: 0 in 0.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:26 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 Nov 03 13:13:26 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1" returned: 0 in 0.239s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.715s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962253049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07760e21-c852-4ba9-908c-e1317837fa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Creating volume 07760e21-c852-4ba9-908c-e1317837fa89 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:27 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9a4659-a1f3-46f9-98c4-eeae38a8df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33378d59-e8df-483f-9d97-d8b1064458c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:27 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 1073741824 Nov 03 13:13:27 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 (0442dc64-87f0-4bb0-9786-cfe8510e62e1): created successfully Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33378d59-e8df-483f-9d97-d8b1064458c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (9221694c-dd5e-43db-8f97-5d23b9ca9083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e987472e-ec63-453a-8193-7d3157594c0c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created volume successfully. Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-6757f1c0-385c-48e9-816a-23579fdd02b4-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-6757f1c0-385c-48e9-816a-23579fdd02b4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-quobyte-6757f1c0-385c-48e9-816a-23579fdd02b4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-6757f1c0-385c-48e9-816a-23579fdd02b4" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e837253-baa1-40da-9d00-02c1f25e3d47]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:27 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 1073741824" returned: 0 in 0.493s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:27 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 Nov 03 13:13:27 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 Nov 03 13:13:27 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89" returned: 0 in 0.248s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17010654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:25Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Creating volume 8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:27 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:27 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4" returned: 0 in 0.396s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:27 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb 1073741824 Nov 03 13:13:27 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1f39c9-c5f1-420a-bc20-81ab2fee0045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07760e21-c852-4ba9-908c-e1317837fa89', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dffab62-4976-454b-96c5-eade4de3457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:27 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4 Nov 03 13:13:27 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume volume-07760e21-c852-4ba9-908c-e1317837fa89 (07760e21-c852-4ba9-908c-e1317837fa89): created successfully Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dffab62-4976-454b-96c5-eade4de3457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (c54259ad-308b-4543-9b4f-b611438a2e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2aad0842-e7a0-45de-a6e9-53d89fd8a850 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created volume successfully. Nov 03 13:13:28 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6757f1c0-385c-48e9-816a-23579fdd02b4" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-6757f1c0-385c-48e9-816a-23579fdd02b4" released by "delete_volume" :: held 0.710s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Created reservations ['4677d451-c60b-4134-bb5a-9084bc928b4d', '0f0b871e-a217-4532-809a-e6062117cf1b', '0b4ad423-8b48-43a6-9724-1e7e1292c7a0', 'e5d9f57b-35ce-410e-a84b-d53e44dd0fe3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:28 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:28 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:28 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb 1073741824" returned: 0 in 0.481s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:28 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb Nov 03 13:13:28 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:28 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Deleted volume successfully. Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf47a1e1-dd3b-416e-b8cc-3fa62f451cda tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-6757f1c0-385c-48e9-816a-23579fdd02b4-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-quobyte-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:28 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.508s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Creating offline snapshot ab324167-b46c-4114-a485-ac56968e037e of volume 1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b38633-f34e-450f-af51-5cc57e7960cb]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2445f321-5b11-4953-b5a9-b2b646a87b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbc868e-a3b1-4f48-ad24-2bb4518f3832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[116dee65-a6ec-4aa2-9ba5-42ed0321659c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb (8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb): created successfully Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbc868e-a3b1-4f48-ad24-2bb4518f3832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (ca6a4fcd-88e6-4ff5-ba81-aba77e53deef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a36fc7e0-4b90-455d-b39f-39e3ef1a9733 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created volume successfully. Nov 03 13:13:28 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 Nov 03 13:13:28 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:28 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 Nov 03 13:13:28 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:29 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17" returned: 0 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:29 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:29 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17 Nov 03 13:13:29 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:29 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e 1G Nov 03 13:13:29 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:29 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17" released by "delete_volume" :: held 0.721s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Created reservations ['b7b7f00e-b9d4-477e-969b-87874f48fe69', '2057bd37-ce0c-40de-b3a9-4f8a1021791f', 'e76ea759-32ee-4efb-ace4-a9f5eef6c261', '02af7bd2-2382-4f86-8ba1-447977c82b5c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:29 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:29 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:29 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e 1G" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1470246e-5358-4ad9-8974-d66ee625a448 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:29 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1470246e-5358-4ad9-8974-d66ee625a448 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e Nov 03 13:13:29 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-0872844c-6d46-44c4-970f-071423c06af6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-0872844c-6d46-44c4-970f-071423c06af6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:29 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Deleted volume successfully. Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb56dbd1-cfaa-4736-b085-890f5a9654f8 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-a1b2fb43-a3c6-4a9e-96d5-0421aa7f8b17-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-quobyte-0872844c-6d46-44c4-970f-071423c06af6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-0872844c-6d46-44c4-970f-071423c06af6" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbff0e2-ec91-4563-8899-d328d0dcadb4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:29 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1470246e-5358-4ad9-8974-d66ee625a448 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:29 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e is being set with open permissions: ugo+rw Nov 03 13:13:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:29 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e Nov 03 13:13:29 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:29 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 Nov 03 13:13:29 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:30 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e" returned: 0 in 0.253s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:30 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.info Nov 03 13:13:30 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:30 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:30 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6 Nov 03 13:13:30 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:30 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.info" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:30 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.info is being set with open permissions: ugo+rw Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:30 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.info Nov 03 13:13:30 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:30 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0872844c-6d46-44c4-970f-071423c06af6" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-0872844c-6d46-44c4-970f-071423c06af6" released by "delete_volume" :: held 0.707s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Created reservations ['bc8519bb-3096-4879-b535-d6f93bfb0c8a', '1d059ed9-44dc-4454-9e3b-829cc0dab764', 'a24cded4-4508-477f-957b-7f3209f1f048', 'eeb265a7-30e8-46f8-940a-734e59377d76'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:30 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.info" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:30 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:30 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.187s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1223629790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1492fe0-f2ec-41ee-be56-251355c43848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:25Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Creating volume d1492fe0-f2ec-41ee-be56-251355c43848 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:30 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:30 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 1073741824 Nov 03 13:13:30 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-99413545-7548-4fda-b8af-baa5f9e00e21 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Create snapshot completed successfully Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-fc1f1c42-7215-4bf0-ade3-b1822c93db0d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-fc1f1c42-7215-4bf0-ade3-b1822c93db0d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:30 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-quobyte-fc1f1c42-7215-4bf0-ade3-b1822c93db0d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Deleted volume successfully. Nov 03 13:13:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-fc1f1c42-7215-4bf0-ade3-b1822c93db0d" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec883a31-9f55-493b-8245-63909eb0d90b tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-0872844c-6d46-44c4-970f-071423c06af6-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed49f69-675d-4bbc-806f-a98a6918e31a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:31 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d Nov 03 13:13:31 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:31 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 1073741824" returned: 0 in 0.551s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:31 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 Nov 03 13:13:31 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:31 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d" returned: 0 in 0.459s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:31 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d Nov 03 13:13:31 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:31 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.713s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369748161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12c8969-c972-46d3-a7ab-47833383a908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f812de0bc90b44e7bc839aa700efa09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:26Z,use_quota=True,user_id='b0e17b0d2c7b44eca9721e5d77c845d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Creating volume f12c8969-c972-46d3-a7ab-47833383a908 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:31 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f92df33-b91b-4ef8-854a-57bc6dd96ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1492fe0-f2ec-41ee-be56-251355c43848', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 1073741824 Nov 03 13:13:31 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37f0907-4265-4446-8a70-70f28ad03fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume volume-d1492fe0-f2ec-41ee-be56-251355c43848 (d1492fe0-f2ec-41ee-be56-251355c43848): created successfully Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37f0907-4265-4446-8a70-70f28ad03fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (dfe46349-e686-43da-8bf7-8880a1795c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8dc0659d-8939-48d4-b291-104d05332da3 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created volume successfully. Nov 03 13:13:31 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fc1f1c42-7215-4bf0-ade3-b1822c93db0d" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (0fcc3e4f-6ec0-4934-aa8a-bc9bf24a46fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c0a61a-91bf-458d-a2b9-1b038b3525bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-fc1f1c42-7215-4bf0-ade3-b1822c93db0d" released by "delete_volume" :: held 0.857s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c0a61a-91bf-458d-a2b9-1b038b3525bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000991145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06b4eac-b638-4897-8bbd-23e7565ee1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:32Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cedf60-730b-43b7-a669-bba9ac79496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cedf60-730b-43b7-a669-bba9ac79496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4db0c14-3881-49fc-a70f-b4d73ff74b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4db0c14-3881-49fc-a70f-b4d73ff74b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f06b4eac-b638-4897-8bbd-23e7565ee1b2', 'volume_name': 'volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b8c4e3-db41-452b-a411-c890ca76edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b8c4e3-db41-452b-a411-c890ca76edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e8ea01-aacf-4fbd-a0f0-12d2246be4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume f06b4eac-b638-4897-8bbd-23e7565ee1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2', 'volume_size': 1} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Created reservations ['8650eca2-1d14-45e1-beea-e3fde40d6c61', '3d219e40-3e65-44aa-a225-6dcd4777abfe', 'f74484b3-11e5-4bd1-a552-7b94a8ee3662', '5dd9f1ea-4833-454b-a3d3-44446da6ad14'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:32 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:32 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-aa94b53b-b571-41aa-b146-4b3915a6540c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-aa94b53b-b571-41aa-b146-4b3915a6540c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "cinder-quobyte-aa94b53b-b571-41aa-b146-4b3915a6540c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-aa94b53b-b571-41aa-b146-4b3915a6540c" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:32 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 1073741824" returned: 0 in 0.743s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb78b87-ecd3-4155-8e56-9e84ff74d6ae]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:32 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (94855a94-adff-49b7-9efb-baebb5d47cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1d4df-1ad2-4db4-bec2-3b3e5448bcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1d4df-1ad2-4db4-bec2-3b3e5448bcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115202063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58564afe-e37a-4c3a-980c-8ba878f91d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:32Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263033bd-7316-43e4-9be4-3308859f2243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263033bd-7316-43e4-9be4-3308859f2243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b14847e-1a66-44a3-8e71-a5988c089330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b14847e-1a66-44a3-8e71-a5988c089330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58564afe-e37a-4c3a-980c-8ba878f91d39', 'volume_name': 'volume-58564afe-e37a-4c3a-980c-8ba878f91d39', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10346d6f-f3fa-4b2d-bb15-34b6408508dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10346d6f-f3fa-4b2d-bb15-34b6408508dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78862935-179e-499d-a016-73e2050892b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume 58564afe-e37a-4c3a-980c-8ba878f91d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58564afe-e37a-4c3a-980c-8ba878f91d39', 'volume_size': 1} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Deleted volume successfully. Nov 03 13:13:32 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c Nov 03 13:13:32 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-85043187-b3c9-4195-ade7-fdb681491576 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-fc1f1c42-7215-4bf0-ade3-b1822c93db0d-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:32 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 Nov 03 13:13:32 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:32 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.402s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f90079c9ff4a6abfe2910cf84c8dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:24Z,use_quota=True,user_id='ce703205665a43458745ecdce70b6101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa4357d1-9159-4007-860f-5a0ecaf5d4d5),volume_type_id=fa4357d1-9159-4007-860f-5a0ecaf5d4d5)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Creating volume 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:32 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:32 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df 1073741824 Nov 03 13:13:32 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (074eb126-beee-41d6-9c17-8093bec8e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e3bbe5-c2f6-4502-be12-fb7fd4e72c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a145f65d-a6fb-4abb-9eaf-b395992e8beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12c8969-c972-46d3-a7ab-47833383a908', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41796d1d-425c-427d-924c-94e3e04c0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c" returned: 0 in 0.546s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Volume volume-f12c8969-c972-46d3-a7ab-47833383a908 (f12c8969-c972-46d3-a7ab-47833383a908): created successfully Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41796d1d-425c-427d-924c-94e3e04c0144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Flow 'volume_create_manager' (1d17560d-544f-4e12-92e0-834530954431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:32 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c Nov 03 13:13:32 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e3bbe5-c2f6-4502-be12-fb7fd4e72c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-853493493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060cd4e0-97f3-43ee-895e-70691736db82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:33Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595623b7-7b65-472d-b1e8-2a3383dbcc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595623b7-7b65-472d-b1e8-2a3383dbcc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebcccfc-c1f7-4b8c-b05c-5dcc830c8c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebcccfc-c1f7-4b8c-b05c-5dcc830c8c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060cd4e0-97f3-43ee-895e-70691736db82', 'volume_name': 'volume-060cd4e0-97f3-43ee-895e-70691736db82', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c22db9-1fe8-4392-9469-e5babdec4932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c22db9-1fe8-4392-9469-e5babdec4932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d90f230-48c0-46b8-9c02-9692faf10e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume 060cd4e0-97f3-43ee-895e-70691736db82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060cd4e0-97f3-43ee-895e-70691736db82', 'volume_size': 1} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5db088dd-e953-49b0-bdf7-6d951f10b3fe tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created volume successfully. Nov 03 13:13:33 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (dcb02586-8fe6-4233-9d47-eaaffca85bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61ce032-a963-4bcc-acd1-66efa0a6ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aa94b53b-b571-41aa-b146-4b3915a6540c" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61ce032-a963-4bcc-acd1-66efa0a6ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1027347817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b6ff1c-771e-4aba-8374-11790cc87304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:33Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583752e9-c65c-4132-ae46-cc86429539b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583752e9-c65c-4132-ae46-cc86429539b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49df67bb-06b3-4218-b4ef-cb8dcde24873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49df67bb-06b3-4218-b4ef-cb8dcde24873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b6ff1c-771e-4aba-8374-11790cc87304', 'volume_name': 'volume-b5b6ff1c-771e-4aba-8374-11790cc87304', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35d75d-cfd5-4630-a178-efc4e0250724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35d75d-cfd5-4630-a178-efc4e0250724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17b2fc4-023f-45b1-9b95-0364098e0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume b5b6ff1c-771e-4aba-8374-11790cc87304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b6ff1c-771e-4aba-8374-11790cc87304', 'volume_size': 1} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-quobyte-aa94b53b-b571-41aa-b146-4b3915a6540c" released by "delete_volume" :: held 1.061s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:33 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Created reservations ['62643b54-d1ae-40a7-9c4e-1845d19550f0', '00e452a7-9e76-4e67-be02-a842fd167924', 'f0e23954-42af-4ae7-8ef1-98777245dd72', '793eb7dd-6020-4a44-95cc-a7143aef717c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df 1073741824" returned: 0 in 0.607s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-f12c8969-c972-46d3-a7ab-47833383a908-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:33 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-f12c8969-c972-46d3-a7ab-47833383a908-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:33 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:33 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:33 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (b1c590a1-e048-40f8-b406-8f1f9c9dcc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b3be6d-0db7-4e50-9588-42abb0f0dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-quobyte-f12c8969-c972-46d3-a7ab-47833383a908" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b3be6d-0db7-4e50-9588-42abb0f0dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090984076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f60a467-9375-47e7-b736-829cac1b184b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:34Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c86f7c-04fc-44a6-a29b-6c65fd7deb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c86f7c-04fc-44a6-a29b-6c65fd7deb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8494a46-6d9f-431a-9d8d-15d2e265059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8494a46-6d9f-431a-9d8d-15d2e265059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f60a467-9375-47e7-b736-829cac1b184b', 'volume_name': 'volume-2f60a467-9375-47e7-b736-829cac1b184b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4476b603-672d-4e27-aa78-73a35e388a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4476b603-672d-4e27-aa78-73a35e388a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d2322-2458-45bc-9748-b2cc81e90ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume 2f60a467-9375-47e7-b736-829cac1b184b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f60a467-9375-47e7-b736-829cac1b184b', 'volume_size': 1} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-f12c8969-c972-46d3-a7ab-47833383a908" acquired by "delete_volume" :: waited 0.059s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccbf4e3-040a-4a59-88ae-518fb2a99fa1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:33 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df" returned: 0 in 0.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000991145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06b4eac-b638-4897-8bbd-23e7565ee1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:32Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Creating volume f06b4eac-b638-4897-8bbd-23e7565ee1b2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:33 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Attempting download of 761b6e2e-3603-4d56-9f36-2060cf2befb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/761b6e2e-3603-4d56-9f36-2060cf2befb3', 'metadata': {}}])) to volume 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:13:33 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 1073741824 Nov 03 13:13:33 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:33 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:33 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 Nov 03 13:13:33 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Deleted volume successfully. Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[62771287-64e9-484e-8851-c6c4a698c4a8]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_761b6e2e-3603-4d56-9f36-2060cf2befb3_dnjg4s72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fff8f656-eec5-4491-a9dc-048ca3cf4505 tempest-CreateVolumesFromImageTest-507282031 None] Lock "cinder-aa94b53b-b571-41aa-b146-4b3915a6540c-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:34 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_761b6e2e-3603-4d56-9f36-2060cf2befb3_dnjg4s72 Nov 03 13:13:34 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908" returned: 0 in 0.403s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908 Nov 03 13:13:34 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_761b6e2e-3603-4d56-9f36-2060cf2befb3_dnjg4s72" returned: 0 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_761b6e2e-3603-4d56-9f36-2060cf2befb3_dnjg4s72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 1073741824" returned: 0 in 0.512s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 Nov 03 13:13:34 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_761b6e2e-3603-4d56-9f36-2060cf2befb3_dnjg4s72 Nov 03 13:13:34 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f12c8969-c972-46d3-a7ab-47833383a908" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-f12c8969-c972-46d3-a7ab-47833383a908" released by "delete_volume" :: held 0.782s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created reservations ['d9303817-f264-4b13-b9ec-6b01a860b037', '6e4cead0-de76-4380-bdea-f5f350c32378', '53250eab-e019-4436-b8c4-0700d7bd1d90', '8111fd65-996d-4935-9d89-99c41f29fe55'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:34 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.319s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115202063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58564afe-e37a-4c3a-980c-8ba878f91d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:32Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Creating volume 58564afe-e37a-4c3a-980c-8ba878f91d39 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:34 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_761b6e2e-3603-4d56-9f36-2060cf2befb3_dnjg4s72" returned: 1 in 0.462s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_761b6e2e-3603-4d56-9f36-2060cf2befb3_dnjg4s72' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d476482c-6e4e-4910-9662-de07c63d8438]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:34 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 1073741824 Nov 03 13:13:34 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e8ea01-aacf-4fbd-a0f0-12d2246be4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24ed710-32c2-4d05-976d-25ff544bd9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 (f06b4eac-b638-4897-8bbd-23e7565ee1b2): created successfully Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24ed710-32c2-4d05-976d-25ff544bd9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (0fcc3e4f-6ec0-4934-aa8a-bc9bf24a46fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-49dd4d87-3364-44c1-9c75-160848bc7f3e tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created volume successfully. Nov 03 13:13:34 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD Nov 03 13:13:35 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:35 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Deleted volume successfully. Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8c80f5fd-8667-4a48-a061-c02609b7343c tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-f12c8969-c972-46d3-a7ab-47833383a908-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:35 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:35 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD Nov 03 13:13:35 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:35 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 1073741824" returned: 0 in 0.617s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:35 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 Nov 03 13:13:35 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:35 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] 761b6e2e-3603-4d56-9f36-2060cf2befb3 was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:35 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df Nov 03 13:13:35 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:35 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39" returned: 0 in 0.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.837s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-853493493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060cd4e0-97f3-43ee-895e-70691736db82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:33Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Creating volume 060cd4e0-97f3-43ee-895e-70691736db82 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:35 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:35 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 1073741824 Nov 03 13:13:35 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78862935-179e-499d-a016-73e2050892b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58564afe-e37a-4c3a-980c-8ba878f91d39', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52958324-a885-4d21-9115-cc56722b12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-d1492fe0-f2ec-41ee-be56-251355c43848-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume volume-58564afe-e37a-4c3a-980c-8ba878f91d39 (58564afe-e37a-4c3a-980c-8ba878f91d39): created successfully Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52958324-a885-4d21-9115-cc56722b12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (94855a94-adff-49b7-9efb-baebb5d47cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-d1492fe0-f2ec-41ee-be56-251355c43848-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3b666169-83be-4257-838e-70e1d442923c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created volume successfully. Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-quobyte-d1492fe0-f2ec-41ee-be56-251355c43848" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-d1492fe0-f2ec-41ee-be56-251355c43848" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc1d1ba-b483-4270-ab9f-b57d0862ed75]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 Nov 03 13:13:36 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df" returned: 0 in 0.698s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_761b6e2e-3603-4d56-9f36-2060cf2befb3_0uji67m9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:13:36 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df 1G Nov 03 13:13:36 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 1073741824" returned: 0 in 0.638s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 Nov 03 13:13:36 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848" returned: 0 in 0.528s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848 Nov 03 13:13:36 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df 1G" returned: 0 in 0.407s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Downloaded image 761b6e2e-3603-4d56-9f36-2060cf2befb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/761b6e2e-3603-4d56-9f36-2060cf2befb3', 'metadata': {}}])) to volume 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Temporary image 761b6e2e-3603-4d56-9f36-2060cf2befb3 for user ce703205665a43458745ecdce70b6101 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Marking volume 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Copying metadata from image 761b6e2e-3603-4d56-9f36-2060cf2befb3 to 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Creating volume glance metadata for volume 658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df backed by image 761b6e2e-3603-4d56-9f36-2060cf2befb3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '761b6e2e-3603-4d56-9f36-2060cf2befb3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '75fab8d13de7a417fb56cc1f87b9d69a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:13:36 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82" returned: 0 in 0.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1027347817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b6ff1c-771e-4aba-8374-11790cc87304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:33Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Creating volume b5b6ff1c-771e-4aba-8374-11790cc87304 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:36 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:36 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 1073741824 Nov 03 13:13:36 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d90f230-48c0-46b8-9c02-9692faf10e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060cd4e0-97f3-43ee-895e-70691736db82', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6544fa3-b286-4372-912e-72ee2a06d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume volume-060cd4e0-97f3-43ee-895e-70691736db82 (060cd4e0-97f3-43ee-895e-70691736db82): created successfully Nov 03 13:13:36 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6544fa3-b286-4372-912e-72ee2a06d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (074eb126-beee-41d6-9c17-8093bec8e93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d1492fe0-f2ec-41ee-be56-251355c43848" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-61e6b7c6-82bd-454e-9f90-b250e15ca580 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created volume successfully. Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d8e7aa-0977-4f97-9215-f1d8a51185ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df', 'volume_size': 1, 'image_id': '761b6e2e-3603-4d56-9f36-2060cf2befb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/761b6e2e-3603-4d56-9f36-2060cf2befb3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75fab8d13de7a417fb56cc1f87b9d69a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91f90079c9ff4a6abfe2910cf84c8dcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '443c7e1881dd3631fd358cb70511269f7d470891864e2fce0cf2c2650194772bf393ba8bb1ff114c81aa026925a36856e4bd0dcca5be7660e5598b8bef67cd84', 'id': '761b6e2e-3603-4d56-9f36-2060cf2befb3', 'created_at': datetime.datetime(2026, 11, 3, 12, 13, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 13, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/761b6e2e-3603-4d56-9f36-2060cf2befb3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59c1c3c-4522-47d9-8701-9bbc3cef427e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-d1492fe0-f2ec-41ee-be56-251355c43848" released by "delete_volume" :: held 0.992s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Volume volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df (658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df): created successfully Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59c1c3c-4522-47d9-8701-9bbc3cef427e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Flow 'volume_create_manager' (fc8ce8f1-3fdf-4854-9748-7e2414921514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a437a434-f2a8-4859-b898-a5e33997c5cb tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Created volume successfully. Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created reservations ['231f09b9-0e9d-409a-a777-c2c1ef6e3704', '39d29dfc-6040-4027-9ef1-35ae30596d2d', '504e633d-4932-486d-ad5c-00e3caca0116', '9a6abc23-5897-4099-b499-c443112c359d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:37 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:37 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:37 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 1073741824" returned: 0 in 0.540s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:37 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 Nov 03 13:13:37 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:37 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Deleted volume successfully. Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3d5be8ba-5499-45fc-9944-dbebb88053f2 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-d1492fe0-f2ec-41ee-be56-251355c43848-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:37 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.932s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090984076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f60a467-9375-47e7-b736-829cac1b184b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a5e32bff54a0aa713668b1d08c876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:34Z,use_quota=True,user_id='92521745be134ff8a4ba29e1fe071471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Creating volume 2f60a467-9375-47e7-b736-829cac1b184b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:37 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:37 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b 1073741824 Nov 03 13:13:37 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17b2fc4-023f-45b1-9b95-0364098e0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b6ff1c-771e-4aba-8374-11790cc87304', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8e1689-a06b-4909-adf9-046a96244355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume volume-b5b6ff1c-771e-4aba-8374-11790cc87304 (b5b6ff1c-771e-4aba-8374-11790cc87304): created successfully Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8e1689-a06b-4909-adf9-046a96244355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (dcb02586-8fe6-4233-9d47-eaaffca85bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-44810b74-1581-49f1-9481-f06e00a61940 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created volume successfully. Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Acquiring lock "cinder-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "cinder-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Acquiring lock "cinder-quobyte-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "cinder-quobyte-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5bb92-280d-4f8f-a862-df053aa3c5d7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:38 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b 1073741824" returned: 0 in 0.547s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:38 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df Nov 03 13:13:38 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:38 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b Nov 03 13:13:38 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-quobyte-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acfbf2f-115f-4e8c-8d3f-e44dbf82c146]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:38 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb Nov 03 13:13:38 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:38 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d2322-2458-45bc-9748-b2cc81e90ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f60a467-9375-47e7-b736-829cac1b184b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8cc5f43-84bf-4f7e-a963-64d80ce16967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Volume volume-2f60a467-9375-47e7-b736-829cac1b184b (2f60a467-9375-47e7-b736-829cac1b184b): created successfully Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8cc5f43-84bf-4f7e-a963-64d80ce16967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Flow 'volume_create_manager' (b1c590a1-e048-40f8-b406-8f1f9c9dcc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:38 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df" returned: 0 in 0.584s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b83dbd09-2224-48af-bbcf-342af4745c90 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created volume successfully. Nov 03 13:13:38 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df Nov 03 13:13:38 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:39 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb Nov 03 13:13:39 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:39 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "cinder-quobyte-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df" released by "delete_volume" :: held 0.965s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Created reservations ['1ae3ca41-8504-457e-aa93-8a4233d57866', 'f3e22f6e-31b0-4601-9d7e-418b15f4e31e', 'e6c786cd-a563-4f47-b77c-b6a77d14daac', '18ecc24a-09b8-4cbd-8175-0bff5c79062e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:39 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:39 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:39 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb" released by "delete_volume" :: held 0.801s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created reservations ['c1364e8a-601e-4a5d-8250-6deeb606698d', 'e824b132-cf55-4559-9e69-5da49f709307', '6af59195-f970-4182-9f9c-dcf8fa74ef2e', 'df9bb611-e3ac-4fa7-9114-3d4d0a02a0f7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:39 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:39 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Deleted volume successfully. Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-2f60a467-9375-47e7-b736-829cac1b184b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-edbe4bd4-3a36-4e1e-89ec-3dd935462696 tempest-VolumeAndVolumeTypeFromImageTest-1824829006 None] Lock "cinder-658f18cb-8e6b-4343-9ac8-d4c8cd6ef1df-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-07760e21-c852-4ba9-908c-e1317837fa89-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-2f60a467-9375-47e7-b736-829cac1b184b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-07760e21-c852-4ba9-908c-e1317837fa89-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-2f60a467-9375-47e7-b736-829cac1b184b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-quobyte-07760e21-c852-4ba9-908c-e1317837fa89" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-07760e21-c852-4ba9-908c-e1317837fa89" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:39 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-2f60a467-9375-47e7-b736-829cac1b184b" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c541626-d80b-4dff-bb62-d973e9684bb8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Deleted volume successfully. Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c3e703-d08d-4764-90fd-84252d8faf82]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c1c44e0d-1c8f-4374-88f3-666b3b94d964 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-8a7f8dc1-d2e3-4ae1-b416-b20b4ed9c8eb-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:39 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 Nov 03 13:13:39 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:39 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b Nov 03 13:13:39 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:40 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89 Nov 03 13:13:40 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:40 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b Nov 03 13:13:40 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-07760e21-c852-4ba9-908c-e1317837fa89" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-07760e21-c852-4ba9-908c-e1317837fa89" released by "delete_volume" :: held 0.788s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:40 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-2f60a467-9375-47e7-b736-829cac1b184b" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-2f60a467-9375-47e7-b736-829cac1b184b" released by "delete_volume" :: held 0.840s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created reservations ['4e28d7f9-e144-4ae1-8632-cff64fde44f2', '0373f40a-7345-48b0-9a66-73b336effe5f', '17a10e57-9ac3-45cf-aeb7-3e707c3c5c30', '2b1e4a02-fc90-486c-92f9-0f7f92d3e6ef'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created reservations ['f286884f-012f-4db2-863e-cc511237469f', '722f5928-6cef-4659-a625-676302c4ea17', 'fc4309eb-2399-46df-a8a3-cc2585812933', 'a7035b47-9f6c-4546-b143-60402b983e9e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:40 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:40 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:40 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:40 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-0442dc64-87f0-4bb0-9786-cfe8510e62e1-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-0442dc64-87f0-4bb0-9786-cfe8510e62e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-quobyte-0442dc64-87f0-4bb0-9786-cfe8510e62e1" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-0442dc64-87f0-4bb0-9786-cfe8510e62e1" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbf5af8-f640-4193-ac23-1cd9e2bab4b9]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:41 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Deleted volume successfully. Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c6896589-d25a-4e41-9fb7-70d8f4755570 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-07760e21-c852-4ba9-908c-e1317837fa89-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:41 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:41 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 Nov 03 13:13:41 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Deleted volume successfully. Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1775b0e9-dfc8-40b4-820e-c4148d2f6f0f tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-2f60a467-9375-47e7-b736-829cac1b184b-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:41 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:41 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1 Nov 03 13:13:41 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:41 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0442dc64-87f0-4bb0-9786-cfe8510e62e1" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-0442dc64-87f0-4bb0-9786-cfe8510e62e1" released by "delete_volume" :: held 0.805s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-b5b6ff1c-771e-4aba-8374-11790cc87304-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-b5b6ff1c-771e-4aba-8374-11790cc87304-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created reservations ['5ea79117-9418-4588-8dad-72e54dab205c', '6642a57b-4726-4e77-b1b2-d1c8eb2e495b', 'fef7f83e-1236-40de-a0ff-a757c39b5462', '00125a84-bd3f-457b-b072-90a23b56756e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-b5b6ff1c-771e-4aba-8374-11790cc87304" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-b5b6ff1c-771e-4aba-8374-11790cc87304" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c531df7-9ed6-4cd7-9ef7-9682c234e010]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:42 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:42 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-f02dd4c5-1418-4c28-95cb-40f1a135320f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:42 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 Nov 03 13:13:42 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-f02dd4c5-1418-4c28-95cb-40f1a135320f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "cinder-quobyte-f02dd4c5-1418-4c28-95cb-40f1a135320f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-f02dd4c5-1418-4c28-95cb-40f1a135320f" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad802a-00e1-40aa-9a5d-f6cc7ac4a682]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:42 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f Nov 03 13:13:42 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:42 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.370s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Deleted volume successfully. Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-704ea6b6-e7d2-4d46-8b6a-574ccfaf585a tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-0442dc64-87f0-4bb0-9786-cfe8510e62e1-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:42 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304" returned: 0 in 0.502s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:42 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304 Nov 03 13:13:42 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:42 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f" returned: 0 in 0.483s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:42 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f Nov 03 13:13:42 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:42 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5b6ff1c-771e-4aba-8374-11790cc87304" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-b5b6ff1c-771e-4aba-8374-11790cc87304" released by "delete_volume" :: held 0.903s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created reservations ['0c2df9d4-41ed-4240-ab35-40f189220690', 'f3c259eb-c0a6-4bb2-86ba-880322df663a', '21a7856c-68a1-4c86-b42b-337b3e3ea386', '63b6387d-3ec7-4d16-a25f-67c7ac186814'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:43 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:43 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-060cd4e0-97f3-43ee-895e-70691736db82-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:43 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f02dd4c5-1418-4c28-95cb-40f1a135320f" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-060cd4e0-97f3-43ee-895e-70691736db82-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-quobyte-f02dd4c5-1418-4c28-95cb-40f1a135320f" released by "delete_volume" :: held 0.950s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-060cd4e0-97f3-43ee-895e-70691736db82" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-060cd4e0-97f3-43ee-895e-70691736db82" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Created reservations ['20e89f81-252f-4b8f-b204-07401f052678', '6af48d30-efc5-4830-bde4-7b1e782946d1', '98480ec6-f9a5-47b1-89b3-ef479b547d8e', 'edc49a6e-a5b4-43b0-a834-3fcd76c7e9b4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[13515a6e-097e-496b-a1f1-288080195d76]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:43 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Deleted volume successfully. Nov 03 13:13:43 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:43 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3572bc5b-9f18-4587-a3d2-a7538d899248 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-b5b6ff1c-771e-4aba-8374-11790cc87304-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:43 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 Nov 03 13:13:43 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:43 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.403s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Deleted volume successfully. Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d56324d9-41a6-4914-b473-81eaba1cafe4 tempest-CreateVolumesFromSourceVolumeTest-2030872951 None] Lock "cinder-f02dd4c5-1418-4c28-95cb-40f1a135320f-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:43 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82" returned: 0 in 0.605s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:43 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82 Nov 03 13:13:43 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:44 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-060cd4e0-97f3-43ee-895e-70691736db82" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-060cd4e0-97f3-43ee-895e-70691736db82" released by "delete_volume" :: held 0.955s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created reservations ['a26b8de7-8b5d-499a-b7d1-7dce6c16d5bc', '570a1a07-14f3-48f8-8440-947b672ba9fb', 'f9ff0c80-a47c-45c3-9880-cd4235166ac1', 'c232d341-1b50-40c0-9d8c-00806bd809ce'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:44 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:44 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:44 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Deleted volume successfully. Nov 03 13:13:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ec288a2-4d7b-4947-9f8b-4364f0fb378c tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-060cd4e0-97f3-43ee-895e-70691736db82-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-58564afe-e37a-4c3a-980c-8ba878f91d39-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-58564afe-e37a-4c3a-980c-8ba878f91d39-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-58564afe-e37a-4c3a-980c-8ba878f91d39" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-58564afe-e37a-4c3a-980c-8ba878f91d39" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f9724-5e0d-4774-af7b-52cb0dbd6e75]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:45 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 Nov 03 13:13:45 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:46 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39" returned: 0 in 0.481s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:46 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39 Nov 03 13:13:46 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:46 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-58564afe-e37a-4c3a-980c-8ba878f91d39" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-58564afe-e37a-4c3a-980c-8ba878f91d39" released by "delete_volume" :: held 0.855s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created reservations ['130383a7-acb8-4f73-8036-32b5b2e30596', '46b2578d-deaa-4a53-be04-e24d84486810', '96be2a62-25a5-4a08-9d71-9ed84656d444', 'b98c292d-6a94-45bf-8462-eb87aec52959'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:46 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:46 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-f06b4eac-b638-4897-8bbd-23e7565ee1b2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-f06b4eac-b638-4897-8bbd-23e7565ee1b2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-f06b4eac-b638-4897-8bbd-23e7565ee1b2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-f06b4eac-b638-4897-8bbd-23e7565ee1b2" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f093c-6fac-4fb5-8756-a2d71039a1b4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:47 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.492s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Deleted volume successfully. Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-49513b7c-906b-4501-b94a-bf78ff203789 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-58564afe-e37a-4c3a-980c-8ba878f91d39-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:47 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 Nov 03 13:13:47 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:47 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2" returned: 0 in 0.694s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:47 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2 Nov 03 13:13:47 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:47 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f06b4eac-b638-4897-8bbd-23e7565ee1b2" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-f06b4eac-b638-4897-8bbd-23e7565ee1b2" released by "delete_volume" :: held 1.043s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:47 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created reservations ['ced30aa3-9c64-4bb3-8032-653036cc4354', '376d3905-e221-4d34-b448-fd1743b74f61', '5e8efef5-5c08-4f99-8103-cdbf0840ffb0', '6e293d8e-d7db-4d58-8c0a-7af941f71b15'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:48 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:48 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:48 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Deleted volume successfully. Nov 03 13:13:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aded2d97-97aa-4d0e-a65a-a6af1269b0d6 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-f06b4eac-b638-4897-8bbd-23e7565ee1b2-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-ab324167-b46c-4114-a485-ac56968e037e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-ab324167-b46c-4114-a485-ac56968e037e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-1470246e-5358-4ad9-8974-d66ee625a448" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-1470246e-5358-4ad9-8974-d66ee625a448" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-ab324167-b46c-4114-a485-ac56968e037e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-ab324167-b46c-4114-a485-ac56968e037e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Deleting offline snapshot ab324167-b46c-4114-a485-ac56968e037e of volume 1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] snapshot_file for this snap is: volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204b1a2-8259-41a4-af41-ad0123393e0b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:49 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e Nov 03 13:13:49 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:49 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1470246e-5358-4ad9-8974-d66ee625a448(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eb2377-7043-492b-92ad-299856307c0e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:49 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 Nov 03 13:13:49 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:50 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:50 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e Nov 03 13:13:50 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:50 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e" returned: 0 in 0.520s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:50 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e Nov 03 13:13:50 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:50 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448.ab324167-b46c-4114-a485-ac56968e037e" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-ab324167-b46c-4114-a485-ac56968e037e" released by "_delete_snapshot" :: held 1.808s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-1470246e-5358-4ad9-8974-d66ee625a448" released by "delete_snapshot" :: held 1.839s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created reservations ['b5cfe32d-79d7-467e-9b66-fa52dba76ff4', '61b3d71d-b0fa-4471-8bf2-d36156ef6a31', 'df660b74-3471-4315-9dd3-de0adac280a0', '4991229e-0e9f-4e16-95b6-50863dbe8765'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Delete snapshot completed successfully. Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9ccfae63-2dce-4aa4-a284-4b5144e32197 tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-ab324167-b46c-4114-a485-ac56968e037e-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-1470246e-5358-4ad9-8974-d66ee625a448-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-1470246e-5358-4ad9-8974-d66ee625a448-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "cinder-quobyte-1470246e-5358-4ad9-8974-d66ee625a448" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-1470246e-5358-4ad9-8974-d66ee625a448" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa460a-3195-40f7-b1e4-00095c61a91f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:51 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 Nov 03 13:13:51 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:51 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448" returned: 0 in 0.505s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:52 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448 Nov 03 13:13:52 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Flow 'volume_create_manager' (174dca46-bea9-44a5-8e97-70d130722438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7f3da3-bb59-4628-9895-dabe0a7fe728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7f3da3-bb59-4628-9895-dabe0a7fe728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580312722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab82b68-58d2-48c3-9d01-1162e3472b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac16036223b84bd4ace9eb04f146dc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:52Z,use_quota=True,user_id='4fc95d7b2d0e46e6afdfe4970ff76fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629613fa-9682-4109-a5ae-73e021918859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629613fa-9682-4109-a5ae-73e021918859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91eaadb1-86f6-44a5-a5a2-e908c92925a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91eaadb1-86f6-44a5-a5a2-e908c92925a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab82b68-58d2-48c3-9d01-1162e3472b2b', 'volume_name': 'volume-fab82b68-58d2-48c3-9d01-1162e3472b2b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4c5160-0124-41f4-9a4f-cfdb5fe99c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4c5160-0124-41f4-9a4f-cfdb5fe99c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1833af0b-0c52-425a-b90e-e1372dc0109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Volume fab82b68-58d2-48c3-9d01-1162e3472b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab82b68-58d2-48c3-9d01-1162e3472b2b', 'volume_size': 1} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580312722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab82b68-58d2-48c3-9d01-1162e3472b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac16036223b84bd4ace9eb04f146dc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:52Z,use_quota=True,user_id='4fc95d7b2d0e46e6afdfe4970ff76fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Creating volume fab82b68-58d2-48c3-9d01-1162e3472b2b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:52 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:52 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b 1073741824 Nov 03 13:13:52 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:52 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1470246e-5358-4ad9-8974-d66ee625a448" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-quobyte-1470246e-5358-4ad9-8974-d66ee625a448" released by "delete_volume" :: held 0.931s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Created reservations ['0c80a70e-abfb-4957-b0bb-a760eaadcc58', 'c1a071a6-6ef5-4e58-b6f7-5298f1ef866d', '55f92680-a550-40e5-b219-bfedf86641cc', '794ead0b-2adf-4d7b-8a1d-7eea141aa680'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:52 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:52 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Flow 'volume_create_manager' (eaddaba6-e464-42d5-8476-7df61f10eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e0d237-00a9-475b-bc8b-08e1dbd6b82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e0d237-00a9-475b-bc8b-08e1dbd6b82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b26c50-7120-4d19-82ea-c21f3d8ec332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b22ab77bb074e40a1e81ef7cc4b5f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:53Z,use_quota=True,user_id='6dba701386ef457a8b97feabc012a769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd5bbaf-e97f-425a-be0d-f29c95e018a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd5bbaf-e97f-425a-be0d-f29c95e018a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dae138-ee8a-4478-9173-157a77263ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 13:13:52 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Deleted volume successfully. Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9b9160db-a639-432f-b935-459f3555defd tempest-CreateVolumesFromSnapshotTest-1126841143 None] Lock "cinder-1470246e-5358-4ad9-8974-d66ee625a448-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:52 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b 1073741824" returned: 0 in 0.734s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:53 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b Nov 03 13:13:53 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:53 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1833af0b-0c52-425a-b90e-e1372dc0109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab82b68-58d2-48c3-9d01-1162e3472b2b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a7a1b7-4424-4de6-a611-c06bf4607873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Volume volume-fab82b68-58d2-48c3-9d01-1162e3472b2b (fab82b68-58d2-48c3-9d01-1162e3472b2b): created successfully Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a7a1b7-4424-4de6-a611-c06bf4607873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Flow 'volume_create_manager' (174dca46-bea9-44a5-8e97-70d130722438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f4ccd471-71b4-4a03-97db-7128b5c48e4c tempest-ProjectReaderTests-1273852622 None] Created volume successfully. Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dae138-ee8a-4478-9173-157a77263ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4b26c50-7120-4d19-82ea-c21f3d8ec332', 'volume_name': 'volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332', 'volume_size': 1, 'image_id': '7b95a711-5748-4680-96c2-9436055a04f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b95a711-5748-4680-96c2-9436055a04f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe1417e4e8498eb8224156a8ff012650', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b22ab77bb074e40a1e81ef7cc4b5f39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2a181dc3c517d7094e452f959d702cd3f2d708438826c49cbc2a760b67f2facc84a45a6b4074da992e8f3653b1819df19d206e04c0797668aff558cdc28b106', 'id': '7b95a711-5748-4680-96c2-9436055a04f8', 'created_at': datetime.datetime(2026, 11, 3, 12, 13, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 13, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b95a711-5748-4680-96c2-9436055a04f8/file', 'properties': {}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84f3812-d60d-49da-b9fa-8037d22a1a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84f3812-d60d-49da-b9fa-8037d22a1a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b1270e-c251-4953-9320-e95d3fc8e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Volume d4b26c50-7120-4d19-82ea-c21f3d8ec332: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332', 'volume_size': 1, 'image_id': '7b95a711-5748-4680-96c2-9436055a04f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b95a711-5748-4680-96c2-9436055a04f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe1417e4e8498eb8224156a8ff012650', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b22ab77bb074e40a1e81ef7cc4b5f39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2a181dc3c517d7094e452f959d702cd3f2d708438826c49cbc2a760b67f2facc84a45a6b4074da992e8f3653b1819df19d206e04c0797668aff558cdc28b106', 'id': '7b95a711-5748-4680-96c2-9436055a04f8', 'created_at': datetime.datetime(2026, 11, 3, 12, 13, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 13, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b95a711-5748-4680-96c2-9436055a04f8/file', 'properties': {}}, 'image_service': } Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Trying to clone d4b26c50-7120-4d19-82ea-c21f3d8ec332 from image 7b95a711-5748-4680-96c2-9436055a04f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b95a711-5748-4680-96c2-9436055a04f8', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 13:13:53 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Image download 0.00 MB at 0.00 MB/s Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a2d84-f309-40f0-a83d-b0ba4090dd13]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:53 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD Nov 03 13:13:53 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:53 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (f9a2150b-e127-4b2e-83a2-09932332d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42bb08-05cc-42eb-b47b-a560e730b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42bb08-05cc-42eb-b47b-a560e730b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719521126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e67229-39a1-4250-b540-b6752563b758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:54Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8d3884-54a0-4a2c-bf63-d1e75e74aa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8d3884-54a0-4a2c-bf63-d1e75e74aa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3ff7c7-c8c5-4972-ac68-cfe6611452be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:54 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD Nov 03 13:13:54 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3ff7c7-c8c5-4972-ac68-cfe6611452be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e67229-39a1-4250-b540-b6752563b758', 'volume_name': 'volume-a1e67229-39a1-4250-b540-b6752563b758', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eda1b17-b999-4528-8d20-039c5a26175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eda1b17-b999-4528-8d20-039c5a26175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fa9f5a-1e02-4cc0-901c-759db9a46a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Volume a1e67229-39a1-4250-b540-b6752563b758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e67229-39a1-4250-b540-b6752563b758', 'volume_size': 1} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719521126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e67229-39a1-4250-b540-b6752563b758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:54Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Creating volume a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:54 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:54 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 1073741824 Nov 03 13:13:54 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:54 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD" returned: 1 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Temporary image 7b95a711-5748-4680-96c2-9436055a04f8 is fetched for user 6dba701386ef457a8b97feabc012a769. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Acquiring lock "cinder-fab82b68-58d2-48c3-9d01-1162e3472b2b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2763d9-3d6b-4d59-8a88-a1044ce5d37a]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-fab82b68-58d2-48c3-9d01-1162e3472b2b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Acquiring lock "cinder-quobyte-fab82b68-58d2-48c3-9d01-1162e3472b2b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-quobyte-fab82b68-58d2-48c3-9d01-1162e3472b2b" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2acfd-757a-47d9-9a1c-2e588a46c511]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:54 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD Nov 03 13:13:54 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:54 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 1073741824" returned: 0 in 0.619s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:54 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b Nov 03 13:13:54 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:54 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 Nov 03 13:13:54 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:55 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD" returned: 0 in 0.504s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:55 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b" returned: 0 in 0.471s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:55 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b Nov 03 13:13:55 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:55 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD Nov 03 13:13:55 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:55 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758" returned: 0 in 0.371s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fa9f5a-1e02-4cc0-901c-759db9a46a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e67229-39a1-4250-b540-b6752563b758', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca293570-8b79-403c-a6b6-981a04d71e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Volume volume-a1e67229-39a1-4250-b540-b6752563b758 (a1e67229-39a1-4250-b540-b6752563b758): created successfully Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca293570-8b79-403c-a6b6-981a04d71e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (f9a2150b-e127-4b2e-83a2-09932332d671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c32e2770-6eec-4f50-9dff-c41aac698eb6 tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:13:55 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-fab82b68-58d2-48c3-9d01-1162e3472b2b" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:55 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD" returned: 1 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b26c50-7120-4d19-82ea-c21f3d8ec332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b22ab77bb074e40a1e81ef7cc4b5f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:53Z,use_quota=True,user_id='6dba701386ef457a8b97feabc012a769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Creating volume d4b26c50-7120-4d19-82ea-c21f3d8ec332 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:55 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-quobyte-fab82b68-58d2-48c3-9d01-1162e3472b2b" released by "delete_volume" :: held 0.846s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:55 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 1073741824 Nov 03 13:13:55 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Created reservations ['efb023d3-e76a-4826-81bc-0e5af0513651', '470ac8b5-a437-4342-80b5-223be1187ccb', '96f509d3-da0e-4a16-86a6-3f23b5d9525c', '2c076907-9b37-467f-908a-12967f73dd6d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:55 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:55 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:55 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:55 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Deleted volume successfully. Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b8244a1-945f-4674-bd73-5a3ff53fa951 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-fab82b68-58d2-48c3-9d01-1162e3472b2b-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:56 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 1073741824" returned: 0 in 0.607s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:56 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 Nov 03 13:13:56 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Flow 'volume_create_manager' (fbb20d4d-70d7-4976-8c2a-eac244d152f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:56 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fd1abb-8df7-4e11-8c65-65d64f699463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fd1abb-8df7-4e11-8c65-65d64f699463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009936439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1938ce4-95ab-44dc-bf43-5cc1d999b0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac16036223b84bd4ace9eb04f146dc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:56Z,use_quota=True,user_id='4fc95d7b2d0e46e6afdfe4970ff76fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d12a68f-0a67-4341-bdcf-2740758252c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d12a68f-0a67-4341-bdcf-2740758252c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b41e52-a63b-4ba3-b35d-5c853180586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b41e52-a63b-4ba3-b35d-5c853180586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1938ce4-95ab-44dc-bf43-5cc1d999b0a7', 'volume_name': 'volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20138e86-3e0b-44b9-b669-5d141a511ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20138e86-3e0b-44b9-b669-5d141a511ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3e1d58-7630-48e8-920e-c3516ba6a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Volume e1938ce4-95ab-44dc-bf43-5cc1d999b0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7', 'volume_size': 1} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009936439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1938ce4-95ab-44dc-bf43-5cc1d999b0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac16036223b84bd4ace9eb04f146dc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:56Z,use_quota=True,user_id='4fc95d7b2d0e46e6afdfe4970ff76fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Creating volume e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:56 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 1073741824 Nov 03 13:13:56 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Attempting download of 7b95a711-5748-4680-96c2-9436055a04f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b95a711-5748-4680-96c2-9436055a04f8', 'metadata': {}}])) to volume d4b26c50-7120-4d19-82ea-c21f3d8ec332. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b540a1aa-9acb-40b4-858c-99aaa21f7811]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b95a711-5748-4680-96c2-9436055a04f8_z2yjw2ac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:56 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b95a711-5748-4680-96c2-9436055a04f8_z2yjw2ac Nov 03 13:13:56 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b95a711-5748-4680-96c2-9436055a04f8_z2yjw2ac" returned: 0 in 0.413s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b95a711-5748-4680-96c2-9436055a04f8_z2yjw2ac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 1073741824" returned: 0 in 0.563s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 Nov 03 13:13:57 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b95a711-5748-4680-96c2-9436055a04f8_z2yjw2ac Nov 03 13:13:57 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Flow 'volume_create_manager' (7b1201ba-87eb-4aa3-90cb-45cea40efdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448346d8-f488-43f0-8260-e37b9f5d82c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448346d8-f488-43f0-8260-e37b9f5d82c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1317323858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2a540b-3697-4781-ab7d-ca99a8bcee68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce224518648483b854f28f84fc0aed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:57Z,use_quota=True,user_id='6c0f250c83e04914860dd490a3a2a141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69502578-c5d1-449f-b8e0-97119bcddc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69502578-c5d1-449f-b8e0-97119bcddc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2300802d-e056-49f7-95f7-f5638d0416c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2300802d-e056-49f7-95f7-f5638d0416c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2a540b-3697-4781-ab7d-ca99a8bcee68', 'volume_name': 'volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a491d08f-6716-4967-9bf4-db6899b93ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a491d08f-6716-4967-9bf4-db6899b93ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea4c78a-72a6-4d42-b13e-670dc1e192d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Volume 3a2a540b-3697-4781-ab7d-ca99a8bcee68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68', 'volume_size': 1} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:57 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b95a711-5748-4680-96c2-9436055a04f8_z2yjw2ac" returned: 1 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b95a711-5748-4680-96c2-9436055a04f8_z2yjw2ac' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:57 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e86b7b-be8d-4300-bf10-e7dc1ec188ae]: (4, 'raw') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.719s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3e1d58-7630-48e8-920e-c3516ba6a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8772c876-9eeb-4eba-9b74-06a01a8d4ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot 76ae706b-3f21-4393-8a1f-2f9df7ab75f3 of volume a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:13:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Volume volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 (e1938ce4-95ab-44dc-bf43-5cc1d999b0a7): created successfully Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8772c876-9eeb-4eba-9b74-06a01a8d4ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Flow 'volume_create_manager' (fbb20d4d-70d7-4976-8c2a-eac244d152f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b44f26-3383-42db-a651-f5db226d6c43]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a6dd30fe-c6e2-4f2f-8739-a4ea56c8142f tempest-ProjectReaderTests-1273852622 None] Created volume successfully. Nov 03 13:13:57 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD Nov 03 13:13:57 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 Nov 03 13:13:57 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD Nov 03 13:13:57 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:57 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:57 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 1G Nov 03 13:13:57 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] 7b95a711-5748-4680-96c2-9436055a04f8 was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 Nov 03 13:13:58 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 1G" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e67229-39a1-4250-b540-b6752563b758 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e67229-39a1-4250-b540-b6752563b758 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 Nov 03 13:13:58 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Acquiring lock "cinder-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Acquiring lock "cinder-quobyte-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-quobyte-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df3868-5863-4c76-962d-8358582a2dbb]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:58 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e67229-39a1-4250-b540-b6752563b758 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3" returned: 0 in 0.339s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:58 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 is being set with open permissions: ugo+rw Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332" returned: 0 in 0.574s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:58 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 Nov 03 13:13:58 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b95a711-5748-4680-96c2-9436055a04f8_99xshkw3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:13:58 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:58 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 Nov 03 13:13:58 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:58 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 1G Nov 03 13:13:58 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:58 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.info Nov 03 13:13:59 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:13:59 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7 Nov 03 13:13:59 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 1G" returned: 0 in 0.430s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Downloaded image 7b95a711-5748-4680-96c2-9436055a04f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b95a711-5748-4680-96c2-9436055a04f8', 'metadata': {}}])) to volume d4b26c50-7120-4d19-82ea-c21f3d8ec332 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Temporary image 7b95a711-5748-4680-96c2-9436055a04f8 for user 6dba701386ef457a8b97feabc012a769 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Marking volume d4b26c50-7120-4d19-82ea-c21f3d8ec332 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Copying metadata from image 7b95a711-5748-4680-96c2-9436055a04f8 to d4b26c50-7120-4d19-82ea-c21f3d8ec332. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Creating volume glance metadata for volume d4b26c50-7120-4d19-82ea-c21f3d8ec332 backed by image 7b95a711-5748-4680-96c2-9436055a04f8 with: {'image_id': '7b95a711-5748-4680-96c2-9436055a04f8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fe1417e4e8498eb8224156a8ff012650', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b1270e-c251-4953-9320-e95d3fc8e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332', 'volume_size': 1, 'image_id': '7b95a711-5748-4680-96c2-9436055a04f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b95a711-5748-4680-96c2-9436055a04f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe1417e4e8498eb8224156a8ff012650', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b22ab77bb074e40a1e81ef7cc4b5f39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2a181dc3c517d7094e452f959d702cd3f2d708438826c49cbc2a760b67f2facc84a45a6b4074da992e8f3653b1819df19d206e04c0797668aff558cdc28b106', 'id': '7b95a711-5748-4680-96c2-9436055a04f8', 'created_at': datetime.datetime(2026, 11, 3, 12, 13, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 12, 13, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b95a711-5748-4680-96c2-9436055a04f8/file', 'properties': {}}, 'image_service': }' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dcc39d-90eb-4174-aad8-b7498108e0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:13:59 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.info" returned: 0 in 0.308s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.info is being set with open permissions: ugo+rw Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Volume volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 (d4b26c50-7120-4d19-82ea-c21f3d8ec332): created successfully Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dcc39d-90eb-4174-aad8-b7498108e0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Flow 'volume_create_manager' (eaddaba6-e464-42d5-8476-7df61f10eede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:13:59 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.info Nov 03 13:13:59 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3505baca-bb4c-40b6-be01-a42b2034cfb0 tempest-VolumeImageDependencyTests-36231037 None] Created volume successfully. Nov 03 13:13:59 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-quobyte-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7" released by "delete_volume" :: held 0.787s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Created reservations ['6ffbbfde-0093-4c19-84cf-60d0ed1fac11', '30d31002-bfee-42be-a9c0-19e19a893b09', '35fdd813-24d4-4b29-ac42-40a114f773a0', '859c3fd6-371e-471f-9c83-ecc345e3d29d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:13:59 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.info" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.235s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1317323858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2a540b-3697-4781-ab7d-ca99a8bcee68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce224518648483b854f28f84fc0aed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:13:57Z,use_quota=True,user_id='6c0f250c83e04914860dd490a3a2a141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Creating volume 3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:13:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:13:59 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 1073741824 Nov 03 13:13:59 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:13:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d62f01ff-0a46-407a-9527-ffb63b91b58d tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:13:59 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:13:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Deleted volume successfully. Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-24bef143-624c-4a79-81b1-2f9d5b4b2936 tempest-ProjectReaderTests-1273852622 None] Lock "cinder-e1938ce4-95ab-44dc-bf43-5cc1d999b0a7-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-76ae706b-3f21-4393-8a1f-2f9df7ab75f3-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Lock "cinder-76ae706b-3f21-4393-8a1f-2f9df7ab75f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-a1e67229-39a1-4250-b540-b6752563b758" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-a1e67229-39a1-4250-b540-b6752563b758" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-76ae706b-3f21-4393-8a1f-2f9df7ab75f3" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:13:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-76ae706b-3f21-4393-8a1f-2f9df7ab75f3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot 76ae706b-3f21-4393-8a1f-2f9df7ab75f3 of volume a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b20957-d054-4a79-8cd3-1018dc72dc15]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:00 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 1073741824" returned: 0 in 0.537s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:00 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 Nov 03 13:14:00 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:00 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 Nov 03 13:14:00 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Acquiring lock "cinder-d4b26c50-7120-4d19-82ea-c21f3d8ec332-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:00 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:00 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Lock "cinder-d4b26c50-7120-4d19-82ea-c21f3d8ec332-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3" returned: 0 in 0.486s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e67229-39a1-4250-b540-b6752563b758(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea4c78a-72a6-4d42-b13e-670dc1e192d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978cfb5d-ef21-4ff3-9521-d85ac092b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a976452-332c-45ad-87cb-c276f6938288]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Volume volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 (3a2a540b-3697-4781-ab7d-ca99a8bcee68): created successfully Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978cfb5d-ef21-4ff3-9521-d85ac092b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Flow 'volume_create_manager' (7b1201ba-87eb-4aa3-90cb-45cea40efdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Acquiring lock "cinder-quobyte-d4b26c50-7120-4d19-82ea-c21f3d8ec332" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-348801ea-5134-438a-86e1-e8073d9ddf15 tempest-VolumeDependencyTests-342604864 None] Created volume successfully. Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Lock "cinder-quobyte-d4b26c50-7120-4d19-82ea-c21f3d8ec332" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[127709ed-e230-4ecb-90cb-26ab4ba7b2e7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:00 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 Nov 03 13:14:00 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:00 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 Nov 03 13:14:00 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:00 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:01 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 Nov 03 13:14:01 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:01 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332" returned: 0 in 0.469s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:01 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332 Nov 03 13:14:01 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:01 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:01 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d4b26c50-7120-4d19-82ea-c21f3d8ec332" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:01 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3 Nov 03 13:14:01 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Lock "cinder-quobyte-d4b26c50-7120-4d19-82ea-c21f3d8ec332" released by "delete_volume" :: held 0.858s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Created reservations ['c268787d-4533-4fee-ab21-fef43b851f32', '2c7133b6-6b30-4c17-8123-76d2986419fc', 'cce342ed-d403-43f1-81e9-69df284da014', '4a709485-8272-481b-89af-dfe0ed5acb1d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:01 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:01 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:01 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758.76ae706b-3f21-4393-8a1f-2f9df7ab75f3" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Creating offline snapshot a309e105-6ff7-456e-94ef-42d93997b357 of volume 3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[362210f4-4b87-445c-886b-37ffef0ed1af]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-76ae706b-3f21-4393-8a1f-2f9df7ab75f3" released by "_delete_snapshot" :: held 1.965s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-a1e67229-39a1-4250-b540-b6752563b758" released by "delete_snapshot" :: held 2.001s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:02 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:02 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Deleted volume successfully. Nov 03 13:14:02 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Created reservations ['7fa80cfd-9af5-4822-af89-5313ed1c87c0', 'c5163ca7-3a08-4262-8cca-eacdbf3990c6', 'fc7339ee-4578-41a7-b59c-cccc2a1307f3', '06b02c55-58fc-4f2c-a5ad-13dc9e2fbc87'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7e656fe2-21ed-4ae8-9e96-482c422863d2 tempest-VolumeImageDependencyTests-36231037 None] Lock "cinder-d4b26c50-7120-4d19-82ea-c21f3d8ec332-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:02 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 Nov 03 13:14:02 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:14:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dc7c9dc3-f73f-4c11-ae54-a5dd054faaac tempest-ProjectMemberTests-1686242941 None] Lock "cinder-76ae706b-3f21-4393-8a1f-2f9df7ab75f3-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:02 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68" returned: 0 in 0.579s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:02 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 1G Nov 03 13:14:02 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:03 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 1G" returned: 0 in 0.507s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 Nov 03 13:14:03 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-a1e67229-39a1-4250-b540-b6752563b758-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Lock "cinder-a1e67229-39a1-4250-b540-b6752563b758-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-a1e67229-39a1-4250-b540-b6752563b758" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-a1e67229-39a1-4250-b540-b6752563b758" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d327a282-017e-470c-a4ff-e33beeb3cd95]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:03 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 is being set with open permissions: ugo+rw Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 Nov 03 13:14:03 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:03 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 Nov 03 13:14:03 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:03 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.info Nov 03 13:14:03 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:03 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:03 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758 Nov 03 13:14:03 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:04 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.info" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:04 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.info is being set with open permissions: ugo+rw Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:04 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.info Nov 03 13:14:04 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:04 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a1e67229-39a1-4250-b540-b6752563b758" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-a1e67229-39a1-4250-b540-b6752563b758" released by "delete_volume" :: held 0.860s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Created reservations ['27548272-3582-49ba-9d57-417b3c3db65e', 'a0b408de-0845-4e5c-b28f-8dce12c47bfd', 'af155a19-9067-444b-8489-2e00336b3481', 'f000c717-c013-487f-b07b-870b2334ca73'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:04 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:04 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:04 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.info" returned: 0 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0b552ead-de9d-4ae4-a18b-838c90ccb559 tempest-VolumeDependencyTests-342604864 None] Create snapshot completed successfully Nov 03 13:14:04 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.439s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (9d1aa9e4-0f6a-4a3b-9a72-33a759490b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884a106-9e65-4fbb-a8d8-aba69b1cdc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4884a106-9e65-4fbb-a8d8-aba69b1cdc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-560743568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a46610-217c-4d2c-ac30-33c8f021b1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:05Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceab617-6e3a-4ee9-9a0a-571cc3958106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceab617-6e3a-4ee9-9a0a-571cc3958106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4517e99d-97bc-48e5-ab11-e0cc6fe99f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4517e99d-97bc-48e5-ab11-e0cc6fe99f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a46610-217c-4d2c-ac30-33c8f021b1f2', 'volume_name': 'volume-52a46610-217c-4d2c-ac30-33c8f021b1f2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7fce1-5ca5-40c5-bbe0-9f4b5380c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7fce1-5ca5-40c5-bbe0-9f4b5380c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f86b89f-e40d-45ce-bcbc-946597a99081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Volume 52a46610-217c-4d2c-ac30-33c8f021b1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a46610-217c-4d2c-ac30-33c8f021b1f2', 'volume_size': 1} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-560743568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a46610-217c-4d2c-ac30-33c8f021b1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:05Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Creating volume 52a46610-217c-4d2c-ac30-33c8f021b1f2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec45005e-68b0-41a2-8b72-7a4b824671dd tempest-ProjectMemberTests-1686242941 None] Lock "cinder-a1e67229-39a1-4250-b540-b6752563b758-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:04 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 1073741824 Nov 03 13:14:04 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (a98c0ac7-91ab-4741-87ed-91c2e424ada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecfe959-a909-4aad-a02d-aacd9b613dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecfe959-a909-4aad-a02d-aacd9b613dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671405799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd74387f-2fe2-45c2-b9ce-35c3a625aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:05Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb935a3-34c1-4f66-be27-cff9f109c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb935a3-34c1-4f66-be27-cff9f109c141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf942b7b-d469-404a-93bf-d6c9d6964611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf942b7b-d469-404a-93bf-d6c9d6964611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd74387f-2fe2-45c2-b9ce-35c3a625aa12', 'volume_name': 'volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b121e1-59a3-4fdb-a629-c6e2d0850170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b121e1-59a3-4fdb-a629-c6e2d0850170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0179722b-3163-461c-962e-0c1b7591323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Volume bd74387f-2fe2-45c2-b9ce-35c3a625aa12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12', 'volume_size': 1} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:05 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 1073741824" returned: 0 in 0.594s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:05 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 Nov 03 13:14:05 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Flow 'volume_create_manager' (e2afb346-5ffe-4044-9758-6d397f377907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df45e40-da98-43ca-9d6c-14a89378ab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df45e40-da98-43ca-9d6c-14a89378ab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1901480372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce224518648483b854f28f84fc0aed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a309e105-6ff7-456e-94ef-42d93997b357,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:06Z,use_quota=True,user_id='6c0f250c83e04914860dd490a3a2a141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b066b8-60f9-47af-a23d-a5c31e6655e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b066b8-60f9-47af-a23d-a5c31e6655e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572bee44-a4ac-433b-a6ff-b8af0e45ea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572bee44-a4ac-433b-a6ff-b8af0e45ea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2', 'volume_name': 'volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2', 'volume_size': 1, 'snapshot_id': 'a309e105-6ff7-456e-94ef-42d93997b357'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f806480-9f8d-4980-8a57-53c344e62797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f806480-9f8d-4980-8a57-53c344e62797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94456f77-1647-4aeb-a70e-b3b940f61148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Volume e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2', 'volume_size': 1, 'snapshot_id': 'a309e105-6ff7-456e-94ef-42d93997b357'} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:05 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671405799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd74387f-2fe2-45c2-b9ce-35c3a625aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:05Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Creating volume bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f86b89f-e40d-45ce-bcbc-946597a99081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a46610-217c-4d2c-ac30-33c8f021b1f2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 1073741824 Nov 03 13:14:05 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06c246e-b045-40b1-a2b0-ab61951cf4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Volume volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 (52a46610-217c-4d2c-ac30-33c8f021b1f2): created successfully Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06c246e-b045-40b1-a2b0-ab61951cf4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (9d1aa9e4-0f6a-4a3b-9a72-33a759490b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-44942d79-d93a-44e9-afb0-3a7ba1f9e11d tempest-ProjectReaderTests-945707734 None] Created volume successfully. Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Flow 'volume_create_manager' (6ec24d43-1b0c-4501-a2bb-802864352216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74507528-649b-4f60-bdee-4d39aa92a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74507528-649b-4f60-bdee-4d39aa92a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e8fac9-3347-4b09-9c69-d643aea70248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f529c21b34d958010fca73ce13ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:06Z,use_quota=True,user_id='e2bcfb8f1f144aae8730cf6aae2a77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4add2d79-9a8a-47f6-8fd8-8805f0bb4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4add2d79-9a8a-47f6-8fd8-8805f0bb4a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee1e6b9-e4f1-4a5b-95a7-57331c73631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee1e6b9-e4f1-4a5b-95a7-57331c73631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e8fac9-3347-4b09-9c69-d643aea70248', 'volume_name': 'volume-f7e8fac9-3347-4b09-9c69-d643aea70248', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bd854d-7bc6-44d6-a8e5-2f2b585e1c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6bd854d-7bc6-44d6-a8e5-2f2b585e1c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7611e58-cbf8-4d82-a27e-22c526f9b55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Volume f7e8fac9-3347-4b09-9c69-d643aea70248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e8fac9-3347-4b09-9c69-d643aea70248', 'volume_size': 1} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:06 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 1073741824" returned: 0 in 0.445s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:06 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 Nov 03 13:14:06 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:06 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" returned: 0 in 0.238s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.788s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-quobyte-a309e105-6ff7-456e-94ef-42d93997b357-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-a309e105-6ff7-456e-94ef-42d93997b357-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Creating volume e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 from snapshot a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-quobyte-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0179722b-3163-461c-962e-0c1b7591323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c420ef-ceba-4c67-9305-533a005ee428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Volume volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 (bd74387f-2fe2-45c2-b9ce-35c3a625aa12): created successfully Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c420ef-ceba-4c67-9305-533a005ee428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (a98c0ac7-91ab-4741-87ed-91c2e424ada8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] snapshot: a309e105-6ff7-456e-94ef-42d93997b357, volume: e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:14:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5d096360-6718-4bf0-afd3-6ebb3cec5987 tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5bdfff-5bc4-4724-bd33-56cd5eca895e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:06 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 Nov 03 13:14:06 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-52a46610-217c-4d2c-ac30-33c8f021b1f2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Lock "cinder-52a46610-217c-4d2c-ac30-33c8f021b1f2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-quobyte-52a46610-217c-4d2c-ac30-33c8f021b1f2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-52a46610-217c-4d2c-ac30-33c8f021b1f2" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[22955468-1f99-4b87-87ff-f58718ad9251]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357" returned: 0 in 0.444s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[043649a9-e6bf-40ae-b899-4a82c0a9870b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:07 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 Nov 03 13:14:07 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 Nov 03 13:14:07 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2 Nov 03 13:14:07 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 Nov 03 13:14:07 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:07 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-52a46610-217c-4d2c-ac30-33c8f021b1f2" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-52a46610-217c-4d2c-ac30-33c8f021b1f2" released by "delete_volume" :: held 0.688s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Created reservations ['6d14ef92-ff6b-4edc-ba69-a32268d14c15', 'be23d509-2181-4569-81cd-b76f08512636', 'dabfc290-d04d-4138-b890-e4642b651ce6', 'd4582f01-e410-48eb-aa09-7d4a2d7db364'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:07 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:07 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:08 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Deleted volume successfully. Nov 03 13:14:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd05628-2188-4b95-9aac-12f43de46d9e tempest-ProjectReaderTests-945707734 None] Lock "cinder-52a46610-217c-4d2c-ac30-33c8f021b1f2-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (bc6e50d8-4e8e-4aaf-a172-557ae4a5cc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b0ff77-b931-4899-acad-219f683cd293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b0ff77-b931-4899-acad-219f683cd293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666296126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:09Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64b58ba-719c-45b8-99e7-217c128097cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64b58ba-719c-45b8-99e7-217c128097cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162232c3-92f4-436a-a266-79928860ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162232c3-92f4-436a-a266-79928860ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde', 'volume_name': 'volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc6cc77-12df-4b18-be06-a2b53ce91350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc6cc77-12df-4b18-be06-a2b53ce91350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a70f04e-e6bb-411c-897d-d99b4b5898da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Volume a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde', 'volume_size': 1} Nov 03 13:14:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:13 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" returned: 0 in 6.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:13 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:14:13 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Converted 1024.00 MB image at 161.84 MB/s Nov 03 13:14:13 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 is being set with open permissions: ugo+rw Nov 03 13:14:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:13 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 Nov 03 13:14:13 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:14 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" returned: 0 in 0.237s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" released by "_copy_volume_from_snapshot" :: held 7.536s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-a309e105-6ff7-456e-94ef-42d93997b357-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" released by "_create_volume_from_snapshot" :: held 7.631s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.651s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.161s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e8fac9-3347-4b09-9c69-d643aea70248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f529c21b34d958010fca73ce13ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:06Z,use_quota=True,user_id='e2bcfb8f1f144aae8730cf6aae2a77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Creating volume f7e8fac9-3347-4b09-9c69-d643aea70248 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:14 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 1073741824 Nov 03 13:14:14 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94456f77-1647-4aeb-a70e-b3b940f61148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2', 'volume_size': 1, 'snapshot_id': 'a309e105-6ff7-456e-94ef-42d93997b357'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b84888-1f72-4344-88d0-7f0cb232e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Volume volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 (e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2): created successfully Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b84888-1f72-4344-88d0-7f0cb232e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Flow 'volume_create_manager' (e2afb346-5ffe-4044-9758-6d397f377907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aec5febb-c15d-48a5-9b8f-f4ef925ad25a tempest-VolumeDependencyTests-342604864 None] Created volume successfully. Nov 03 13:14:14 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 1073741824" returned: 0 in 0.423s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:14 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 Nov 03 13:14:14 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:14 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248" returned: 0 in 0.232s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.696s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7611e58-cbf8-4d82-a27e-22c526f9b55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e8fac9-3347-4b09-9c69-d643aea70248', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d3d58b-0906-4a54-afe2-3321674df283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot 1daa05c5-08af-4c38-bb9c-d88d75205a4c of volume bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Volume volume-f7e8fac9-3347-4b09-9c69-d643aea70248 (f7e8fac9-3347-4b09-9c69-d643aea70248): created successfully Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d3d58b-0906-4a54-afe2-3321674df283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Flow 'volume_create_manager' (6ec24d43-1b0c-4501-a2bb-802864352216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b7a34-4fba-4ef8-ade5-cf7319dba98a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ae03b8e7-17f5-4064-bdf2-da81c7c4c908 tempest-CinderUnicodeTest-72005317 None] Created volume successfully. Nov 03 13:14:15 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 Nov 03 13:14:15 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:15 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:15 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c 1G Nov 03 13:14:15 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-a309e105-6ff7-456e-94ef-42d93997b357-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Lock "cinder-a309e105-6ff7-456e-94ef-42d93997b357-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-quobyte-3a2a540b-3697-4781-ab7d-ca99a8bcee68" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-3a2a540b-3697-4781-ab7d-ca99a8bcee68" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-quobyte-a309e105-6ff7-456e-94ef-42d93997b357" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-a309e105-6ff7-456e-94ef-42d93997b357" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Deleting offline snapshot a309e105-6ff7-456e-94ef-42d93997b357 of volume 3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] snapshot_file for this snap is: volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88c22f4-cd3f-4bc7-aa8e-531658d622f0]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:15 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 Nov 03 13:14:15 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:15 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c 1G" returned: 0 in 0.447s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:15 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c Nov 03 13:14:15 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:15 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa2cd78-669f-402d-a85e-374dd26a8336]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:16 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 Nov 03 13:14:16 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:16 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:16 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c is being set with open permissions: ugo+rw Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:16 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c Nov 03 13:14:16 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Flow 'volume_create_manager' (932e0ed2-2324-45ac-817b-247c841dff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8e5377-e5be-4cb6-8d0d-097e20787405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8e5377-e5be-4cb6-8d0d-097e20787405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1411959173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafc8b12-78a6-4714-a949-2c25782fea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f529c21b34d958010fca73ce13ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:16Z,use_quota=True,user_id='e2bcfb8f1f144aae8730cf6aae2a77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68784e6-8958-4a81-9602-5e9ef8c0ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68784e6-8958-4a81-9602-5e9ef8c0ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6980b5-6e56-43a1-8187-5b7a71d5a5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6980b5-6e56-43a1-8187-5b7a71d5a5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafc8b12-78a6-4714-a949-2c25782fea5c', 'volume_name': 'volume-aafc8b12-78a6-4714-a949-2c25782fea5c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855ed966-f86c-4d7f-9399-30f2311b735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855ed966-f86c-4d7f-9399-30f2311b735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf3cd75-6d65-46da-93ae-55a25f7d0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Volume aafc8b12-78a6-4714-a949-2c25782fea5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafc8b12-78a6-4714-a949-2c25782fea5c', 'volume_size': 1} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:16 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:16 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.info Nov 03 13:14:16 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:16 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68" returned: 0 in 0.611s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:16 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 Nov 03 13:14:16 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:16 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.info" returned: 0 in 0.253s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:16 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.info is being set with open permissions: ugo+rw Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:16 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.info Nov 03 13:14:16 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:16 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357" returned: 0 in 0.343s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:16 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357 Nov 03 13:14:16 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:17 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.info" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.769s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666296126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:09Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Creating volume a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=284,cinder:SELECT=203,cinder:INSERT=74,cinder:DELETE=33 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:14:17 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde 1073741824 Nov 03 13:14:17 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d422e20e-78ff-483c-9a2a-4f0478ca6b88 tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=214,cinder:UPDATE=289,cinder:INSERT=76,cinder:DELETE=21 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:14:17 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68.a309e105-6ff7-456e-94ef-42d93997b357" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-a309e105-6ff7-456e-94ef-42d93997b357" released by "_delete_snapshot" :: held 1.724s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-3a2a540b-3697-4781-ab7d-ca99a8bcee68" released by "delete_snapshot" :: held 1.748s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Created reservations ['9a2e0566-cf3a-4fd8-b97b-e64222240774', 'da4a7fa0-3f27-416a-b6c1-aff4d7b259f2', '33aba336-e523-4275-980f-dda546ecfc42', '91d402a1-864f-4109-bde6-a073692f967d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Delete snapshot completed successfully. Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3532adb5-a1e9-41a4-9fcb-84e2dee0564f tempest-VolumeDependencyTests-342604864 None] Lock "cinder-a309e105-6ff7-456e-94ef-42d93997b357-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:17 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde 1073741824" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:17 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde Nov 03 13:14:17 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-3a2a540b-3697-4781-ab7d-ca99a8bcee68-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Lock "cinder-3a2a540b-3697-4781-ab7d-ca99a8bcee68-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-quobyte-3a2a540b-3697-4781-ab7d-ca99a8bcee68" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-3a2a540b-3697-4781-ab7d-ca99a8bcee68" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-1daa05c5-08af-4c38-bb9c-d88d75205a4c-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-1daa05c5-08af-4c38-bb9c-d88d75205a4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d464521-febe-4e3d-87d0-eb6d7bcbf336]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-1daa05c5-08af-4c38-bb9c-d88d75205a4c" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-1daa05c5-08af-4c38-bb9c-d88d75205a4c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot 1daa05c5-08af-4c38-bb9c-d88d75205a4c of volume bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:17 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bdef9-e192-494b-b6b2-c89d9774fdb7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1411959173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafc8b12-78a6-4714-a949-2c25782fea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f529c21b34d958010fca73ce13ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:16Z,use_quota=True,user_id='e2bcfb8f1f144aae8730cf6aae2a77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Creating volume aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:17 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 Nov 03 13:14:17 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a70f04e-e6bb-411c-897d-d99b4b5898da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:17 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c 1073741824 Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58c9575-73fc-4220-a3ea-8c46e5eefb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:17 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Volume volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde (a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde): created successfully Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58c9575-73fc-4220-a3ea-8c46e5eefb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (bc6e50d8-4e8e-4aaf-a172-557ae4a5cc0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4f2c8c7e-9828-458c-af59-8a88b17334eb tempest-ProjectReaderTests-945707734 None] Created volume successfully. Nov 03 13:14:17 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c Nov 03 13:14:17 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:18 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68" returned: 0 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68 Nov 03 13:14:18 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:18 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c" returned: 0 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb17568d-858d-4925-a1ba-0dbeb2a25c8f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c 1073741824" returned: 0 in 0.525s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:18 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 Nov 03 13:14:18 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c Nov 03 13:14:18 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:18 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-3a2a540b-3697-4781-ab7d-ca99a8bcee68" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-3a2a540b-3697-4781-ab7d-ca99a8bcee68" released by "delete_volume" :: held 0.819s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Created reservations ['a46bb644-a54c-4eac-9313-4db03bab992c', 'db4af750-519d-4007-828a-b80b705cef08', 'b59cfe57-61bf-405a-913e-a9d36e9ad3c7', 'efdb8f45-97a3-4f35-8127-16ef9b813da3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:18 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Lock "cinder-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:18 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf3cd75-6d65-46da-93ae-55a25f7d0382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafc8b12-78a6-4714-a949-2c25782fea5c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acd87d3-bf44-4274-8481-ea2d7e612407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:18 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" returned: 0 in 0.513s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-quobyte-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Volume volume-aafc8b12-78a6-4714-a949-2c25782fea5c (aafc8b12-78a6-4714-a949-2c25782fea5c): created successfully Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acd87d3-bf44-4274-8481-ea2d7e612407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:18 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Flow 'volume_create_manager' (932e0ed2-2324-45ac-817b-247c841dff67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:18 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0b03425e-cbc7-4ea9-8c45-9bb528973d88 tempest-CinderUnicodeTest-72005317 None] Created volume successfully. Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde" acquired by "delete_volume" :: waited 0.059s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Lock "cinder-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf798ef1-a909-415e-bc05-b8db9bea72c8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Acquiring lock "cinder-quobyte-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:19 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.371s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Deleted volume successfully. Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8105c159-187c-4542-85c7-8f6e8b2e31a8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a73d5f65-853b-4d10-8b31-925b642a8afe tempest-VolumeDependencyTests-342604864 None] Lock "cinder-3a2a540b-3697-4781-ab7d-ca99a8bcee68-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:19 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde Nov 03 13:14:19 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 Nov 03 13:14:19 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c Nov 03 13:14:19 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde Nov 03 13:14:19 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12.1daa05c5-08af-4c38-bb9c-d88d75205a4c" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2 Nov 03 13:14:19 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-1daa05c5-08af-4c38-bb9c-d88d75205a4c" released by "_delete_snapshot" :: held 1.784s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" released by "delete_snapshot" :: held 1.812s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:19 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde" released by "delete_volume" :: held 0.830s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Created reservations ['133f636f-d6ac-4f91-a3bd-45a7e91b9731', '1106f78f-5950-4af9-aed0-7a301b6d5daa', 'bb884751-d436-4529-85f4-b3f4eb5fa6d8', 'cd9ccf22-e124-4098-9a2a-d963abccfb97'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8b5330d2-ae9e-4982-b2af-01e3fbab5c04 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-1daa05c5-08af-4c38-bb9c-d88d75205a4c-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Created reservations ['5c685236-eed4-43da-b161-97d660a38504', '94c99629-40ac-4d30-95d8-d65449cdb20a', '1f8fb80c-9cdb-4f4e-aeed-7e41f72e11a7', '3cd95378-8ee4-43ba-8981-5763546d2f93'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Creating offline snapshot 059c3929-9097-4d84-b5c4-756c4f84b44e of volume aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:19 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Lock "cinder-quobyte-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2" released by "delete_volume" :: held 0.923s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef19ece-b31c-44c4-8975-31faacf81da2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-bd74387f-2fe2-45c2-b9ce-35c3a625aa12-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:20 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:20 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Lock "cinder-bd74387f-2fe2-45c2-b9ce-35c3a625aa12-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Created reservations ['4be0e784-a8db-49c7-978f-bf86087ea3f5', 'a5054ffd-c52e-49ec-a89c-270349fdbf35', '7485b79a-b948-4e56-b42d-423eadf40590', 'ae76f442-b33d-49a4-9cd2-484d74be2030'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:20 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c Nov 03 13:14:20 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d10750-ed7a-46dc-8efe-1c80a638035b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:20 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:20 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 Nov 03 13:14:20 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Deleted volume successfully. Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-75d78ec9-bff1-440f-8926-803bd714400f tempest-ProjectReaderTests-945707734 None] Lock "cinder-a74e8e6b-eb7a-41da-b8ac-b35c9e33bfde-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:20 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c" returned: 0 in 0.491s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e 1G Nov 03 13:14:20 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Deleted volume successfully. Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-723f510e-d458-445c-a63b-106bd5aa2f08 tempest-VolumeDependencyTests-342604864 None] Lock "cinder-e0abbdd8-b0ce-4c89-a819-096e4a3c2ad2-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:20 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" returned: 0 in 0.413s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12 Nov 03 13:14:20 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e 1G" returned: 0 in 0.404s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafc8b12-78a6-4714-a949-2c25782fea5c -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:20 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafc8b12-78a6-4714-a949-2c25782fea5c -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e Nov 03 13:14:20 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:20 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-bd74387f-2fe2-45c2-b9ce-35c3a625aa12" released by "delete_volume" :: held 0.785s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Created reservations ['e3cdf04d-ddea-4aa8-8b75-7d2781371d00', 'c328ab16-074b-447b-a71c-c073cbce8207', '567cc8d7-6cb7-410e-8a38-fab7bbfe4a69', '2e82d274-63d4-44d8-8d0f-e373ad64dfe4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:21 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:21 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:21 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafc8b12-78a6-4714-a949-2c25782fea5c -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:21 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e is being set with open permissions: ugo+rw Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:21 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e Nov 03 13:14:21 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:21 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.317s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7b1f85df-1e26-4fb9-9543-51f7dff63d6d tempest-ProjectMemberTests-1686242941 None] Lock "cinder-bd74387f-2fe2-45c2-b9ce-35c3a625aa12-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:21 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:21 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.info Nov 03 13:14:21 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (2f5a58d6-2231-4e8d-a15e-07ee9a89c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6926d0-b4fe-4a46-84f1-d2d966e43216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6926d0-b4fe-4a46-84f1-d2d966e43216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546842569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18495015-e77b-41e1-86aa-ae51fff34c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:22Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f55559c-90da-4f5a-ba36-868a8944a3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f55559c-90da-4f5a-ba36-868a8944a3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0298a97a-fa20-48f5-8922-da3d9cd0f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0298a97a-fa20-48f5-8922-da3d9cd0f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18495015-e77b-41e1-86aa-ae51fff34c6f', 'volume_name': 'volume-18495015-e77b-41e1-86aa-ae51fff34c6f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88cb655-ca96-457f-92d7-153f8479d8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88cb655-ca96-457f-92d7-153f8479d8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc7ce7d-4f7b-4d25-8524-5ecb6ad0cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Volume 18495015-e77b-41e1-86aa-ae51fff34c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18495015-e77b-41e1-86aa-ae51fff34c6f', 'volume_size': 1} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:21 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.info" returned: 0 in 0.308s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:21 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.info is being set with open permissions: ugo+rw Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:21 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.info Nov 03 13:14:21 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (9a6b649e-d20f-4c7d-87c5-8ba4534c3772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04afa862-ae75-483a-84aa-3b057fd8d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04afa862-ae75-483a-84aa-3b057fd8d18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937731565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bb6e6b-2d4d-4ad5-8961-164dd53098cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:22Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6df5d07-ee11-4ad1-8075-5ae8c41098ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6df5d07-ee11-4ad1-8075-5ae8c41098ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d2ba53-deae-46f2-9c1f-8b576f2db5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d2ba53-deae-46f2-9c1f-8b576f2db5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bb6e6b-2d4d-4ad5-8961-164dd53098cc', 'volume_name': 'volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b503746-6464-47b2-9978-fdfa6705e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b503746-6464-47b2-9978-fdfa6705e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9958e4f5-bbba-46ad-9595-ea66ac31cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Volume 10bb6e6b-2d4d-4ad5-8961-164dd53098cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc', 'volume_size': 1} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:22 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.info" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546842569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18495015-e77b-41e1-86aa-ae51fff34c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:22Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Creating volume 18495015-e77b-41e1-86aa-ae51fff34c6f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:22 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f 1073741824 Nov 03 13:14:22 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-db26853a-0c59-4263-85ad-3bf4a9c806fd tempest-CinderUnicodeTest-72005317 None] Create snapshot completed successfully Nov 03 13:14:22 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f 1073741824" returned: 0 in 0.459s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:22 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f Nov 03 13:14:22 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:22 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937731565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bb6e6b-2d4d-4ad5-8961-164dd53098cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:22Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Creating volume 10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc7ce7d-4f7b-4d25-8524-5ecb6ad0cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18495015-e77b-41e1-86aa-ae51fff34c6f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:22 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc 1073741824 Nov 03 13:14:22 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f6f59d-8f49-4225-9c49-16b42a7df6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Volume volume-18495015-e77b-41e1-86aa-ae51fff34c6f (18495015-e77b-41e1-86aa-ae51fff34c6f): created successfully Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f6f59d-8f49-4225-9c49-16b42a7df6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (2f5a58d6-2231-4e8d-a15e-07ee9a89c421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1197006a-d329-4997-9ee0-81eeb0dcbc6d tempest-ProjectReaderTests-945707734 None] Created volume successfully. Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Acquiring lock "cinder-059c3929-9097-4d84-b5c4-756c4f84b44e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Lock "cinder-059c3929-9097-4d84-b5c4-756c4f84b44e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Acquiring lock "cinder-quobyte-aafc8b12-78a6-4714-a949-2c25782fea5c" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-aafc8b12-78a6-4714-a949-2c25782fea5c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Acquiring lock "cinder-quobyte-059c3929-9097-4d84-b5c4-756c4f84b44e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-059c3929-9097-4d84-b5c4-756c4f84b44e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Deleting offline snapshot 059c3929-9097-4d84-b5c4-756c4f84b44e of volume aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] snapshot_file for this snap is: volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffadd7-b1ca-48b5-bb4b-04f6a68eaade]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:23 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e Nov 03 13:14:23 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:23 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc 1073741824" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:23 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc Nov 03 13:14:23 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:23 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e" returned: 0 in 0.480s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aafc8b12-78a6-4714-a949-2c25782fea5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[687e06c2-3214-4f9d-a8ea-4344377572d6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-18495015-e77b-41e1-86aa-ae51fff34c6f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Lock "cinder-18495015-e77b-41e1-86aa-ae51fff34c6f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:23 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c Nov 03 13:14:23 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-quobyte-18495015-e77b-41e1-86aa-ae51fff34c6f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-18495015-e77b-41e1-86aa-ae51fff34c6f" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:23 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0da9f1-0785-46d3-a05f-aa09903b1e8d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9958e4f5-bbba-46ad-9595-ea66ac31cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd2234b-e2af-48c2-9c57-d0aabcc97dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Volume volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc (10bb6e6b-2d4d-4ad5-8961-164dd53098cc): created successfully Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd2234b-e2af-48c2-9c57-d0aabcc97dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (9a6b649e-d20f-4c7d-87c5-8ba4534c3772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-242875a7-9c3e-4bc9-8b45-c40ce2ad8453 tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:14:24 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f Nov 03 13:14:24 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:24 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c" returned: 0 in 0.450s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:24 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e Nov 03 13:14:24 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:24 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f" returned: 0 in 0.429s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:24 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f Nov 03 13:14:24 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:24 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:24 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e Nov 03 13:14:24 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:24 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-18495015-e77b-41e1-86aa-ae51fff34c6f" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-18495015-e77b-41e1-86aa-ae51fff34c6f" released by "delete_volume" :: held 0.774s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Created reservations ['f3dc5626-66ed-40f3-a817-a481405723ee', '1dfa9125-a8a7-4fdb-9739-f9c848f6d72c', 'ea584759-f090-4fbd-93c4-e7887a23a61b', 'f653c583-333f-49ee-879d-cc504f107fc9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:24 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:24 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:24 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c.059c3929-9097-4d84-b5c4-756c4f84b44e" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-059c3929-9097-4d84-b5c4-756c4f84b44e" released by "_delete_snapshot" :: held 1.749s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-aafc8b12-78a6-4714-a949-2c25782fea5c" released by "delete_snapshot" :: held 1.785s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Created reservations ['433bb003-82dd-429a-b9b1-6b59c3e978f7', '2441c50c-0779-45e9-bb86-860ade5277ee', '25c6a04a-3fc5-45ef-9e16-eac4e82ebd20', '38a5bf61-a8ed-4c63-aeb9-0a9264c47d36'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Delete snapshot completed successfully. Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d412ab3a-e887-4b2c-856b-f578f02722aa tempest-CinderUnicodeTest-72005317 None] Lock "cinder-059c3929-9097-4d84-b5c4-756c4f84b44e-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:25 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Deleted volume successfully. Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fa01cdde-9afd-4380-a013-f3da146460f6 tempest-ProjectReaderTests-945707734 None] Lock "cinder-18495015-e77b-41e1-86aa-ae51fff34c6f-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3a507259-0af1-4e86-9676-5bbe8de4368e tempest-ProjectAdminTests-150839471 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7330017089844, 'free_capacity_gb': 1773.7330017089844, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "cinder-aafc8b12-78a6-4714-a949-2c25782fea5c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-aafc8b12-78a6-4714-a949-2c25782fea5c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "cinder-quobyte-aafc8b12-78a6-4714-a949-2c25782fea5c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (7ac76fd6-32cb-44cb-92aa-cac4eca8306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe109a5a-006a-42f2-98c9-93baef2b4646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-aafc8b12-78a6-4714-a949-2c25782fea5c" acquired by "delete_volume" :: waited 0.052s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe109a5a-006a-42f2-98c9-93baef2b4646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823051235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ae1d52-efda-4962-b7ab-ea31fe94411f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:25Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76784a0d-9aec-40d3-9afb-10e22f0b22e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76784a0d-9aec-40d3-9afb-10e22f0b22e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180f788d-7c3d-4302-bd5e-0b9263c94c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180f788d-7c3d-4302-bd5e-0b9263c94c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ae1d52-efda-4962-b7ab-ea31fe94411f', 'volume_name': 'volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11538f59-a4a3-4868-8df4-b0c3571ff232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11538f59-a4a3-4868-8df4-b0c3571ff232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65faee2-e554-49b6-a1a8-dd83a1de2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Volume b5ae1d52-efda-4962-b7ab-ea31fe94411f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f', 'volume_size': 1} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823051235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ae1d52-efda-4962-b7ab-ea31fe94411f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e8caa7b6240afa66d0447b74eeb03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:25Z,use_quota=True,user_id='eb28c78abbd74d5e9e76246549ea8736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Creating volume b5ae1d52-efda-4962-b7ab-ea31fe94411f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:25 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb5b24-2fae-4fa5-b820-7e14104e10b7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:25 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f 1073741824 Nov 03 13:14:25 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:25 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c Nov 03 13:14:25 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:26 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c" returned: 0 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:26 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c Nov 03 13:14:26 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:26 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f 1073741824" returned: 0 in 0.486s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:26 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f Nov 03 13:14:26 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:26 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-aafc8b12-78a6-4714-a949-2c25782fea5c" returned: 0 in 0.281s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-aafc8b12-78a6-4714-a949-2c25782fea5c" released by "delete_volume" :: held 0.859s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:26 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.760s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot 8f89a3c0-0884-4df3-ba86-c803d316cb4e of volume 10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65faee2-e554-49b6-a1a8-dd83a1de2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40105698-3520-4e8d-9146-6d4750f192ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d01f5-9158-4e88-b13f-a15b67f5387f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Created reservations ['58293f4b-478e-4872-913e-67d2e359fc2d', 'bc30ff11-07c5-45d5-b562-a682e84d4d75', 'fe8f4f2c-7bcd-441c-ab71-856ab1d1801f', 'a6c910eb-6b84-4d35-a0f1-56260e3a7e60'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Volume volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f (b5ae1d52-efda-4962-b7ab-ea31fe94411f): created successfully Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40105698-3520-4e8d-9146-6d4750f192ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Flow 'volume_create_manager' (7ac76fd6-32cb-44cb-92aa-cac4eca8306d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a00b36d4-ce61-46e9-b61c-1013e9d14b9e tempest-ProjectReaderTests-945707734 None] Created volume successfully. Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:26 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc Nov 03 13:14:26 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:26 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:26 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "cinder-f7e8fac9-3347-4b09-9c69-d643aea70248-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-f7e8fac9-3347-4b09-9c69-d643aea70248-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "cinder-quobyte-f7e8fac9-3347-4b09-9c69-d643aea70248" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-f7e8fac9-3347-4b09-9c69-d643aea70248" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c134733c-d06f-4a12-9e03-77ca2fd7ebaf]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:27 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" returned: 0 in 0.505s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:27 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Deleted volume successfully. Nov 03 13:14:27 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e 1G Nov 03 13:14:27 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-915a911b-a5b2-4fa0-9d23-fbdcc90b0b33 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-aafc8b12-78a6-4714-a949-2c25782fea5c-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:27 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 Nov 03 13:14:27 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:27 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:27 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248 Nov 03 13:14:27 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:27 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e 1G" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:27 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e Nov 03 13:14:27 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-b5ae1d52-efda-4962-b7ab-ea31fe94411f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Lock "cinder-b5ae1d52-efda-4962-b7ab-ea31fe94411f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Acquiring lock "cinder-quobyte-b5ae1d52-efda-4962-b7ab-ea31fe94411f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-b5ae1d52-efda-4962-b7ab-ea31fe94411f" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cc2f57-3699-468f-8ab8-b58ee38997f9]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:27 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-f7e8fac9-3347-4b09-9c69-d643aea70248" returned: 0 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-quobyte-f7e8fac9-3347-4b09-9c69-d643aea70248" released by "delete_volume" :: held 0.848s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:27 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Created reservations ['646b4f99-8be2-41b5-ae15-f29aea5662c7', '67a94080-c17f-4053-82c8-8a026d348477', 'e1abe01a-eed3-43bf-bf02-774d26d5450b', '405d3283-fb7c-4e94-98c3-d4cb353c5e29'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:27 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f Nov 03 13:14:27 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e is being set with open permissions: ugo+rw Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:28 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e Nov 03 13:14:28 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f" returned: 0 in 0.550s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f Nov 03 13:14:28 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Deleted volume successfully. Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-01b44b01-d418-4104-9ee5-152b1e1b3650 tempest-CinderUnicodeTest-72005317 None] Lock "cinder-f7e8fac9-3347-4b09-9c69-d643aea70248-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:28 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.info Nov 03 13:14:28 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b5ae1d52-efda-4962-b7ab-ea31fe94411f" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Lock "cinder-quobyte-b5ae1d52-efda-4962-b7ab-ea31fe94411f" released by "delete_volume" :: held 0.907s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Created reservations ['7af827c6-0dc7-4960-a639-faea049bce04', 'e681d7d9-9d7b-4bf5-b479-ee651524fa87', 'a99d54c4-499a-46bb-ad92-af960b2998ee', 'b9fdd6e3-5a28-40f7-8501-dddbd7252572'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.info" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:28 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.info is being set with open permissions: ugo+rw Nov 03 13:14:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:28 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:28 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:28 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.info Nov 03 13:14:28 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:29 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:29 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.info" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Deleted volume successfully. Nov 03 13:14:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4609202b-4fde-4f18-af73-7de7cf2bb2bc tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca15eff0-301c-4324-a7de-362d631da98d tempest-ProjectReaderTests-945707734 None] Lock "cinder-b5ae1d52-efda-4962-b7ab-ea31fe94411f-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-8f89a3c0-0884-4df3-ba86-c803d316cb4e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-8f89a3c0-0884-4df3-ba86-c803d316cb4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-8f89a3c0-0884-4df3-ba86-c803d316cb4e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-8f89a3c0-0884-4df3-ba86-c803d316cb4e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot 8f89a3c0-0884-4df3-ba86-c803d316cb4e of volume 10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[85963f23-eab8-4d16-a4bb-250e7c4ccb1e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:30 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e Nov 03 13:14:30 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:30 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e" returned: 0 in 0.426s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c557480b-d122-4dd6-a4eb-7f3498373f70]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:30 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc Nov 03 13:14:30 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:31 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:31 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e Nov 03 13:14:31 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:31 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e" returned: 0 in 0.506s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:31 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e Nov 03 13:14:31 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:31 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc.8f89a3c0-0884-4df3-ba86-c803d316cb4e" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-8f89a3c0-0884-4df3-ba86-c803d316cb4e" released by "_delete_snapshot" :: held 1.833s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" released by "delete_snapshot" :: held 1.869s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Created reservations ['5fc99703-5672-475b-8f0b-121a86628c04', '3e3ad787-0e04-4210-8289-7ca718120497', '3f48e90b-98b7-444c-aaf3-57560a787443', '1f023075-b23c-41a9-95da-f59d0962a461'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5fdeae14-4137-4372-9928-a8823dcfd933 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-8f89a3c0-0884-4df3-ba86-c803d316cb4e-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-10bb6e6b-2d4d-4ad5-8961-164dd53098cc-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-10bb6e6b-2d4d-4ad5-8961-164dd53098cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d344983f-9fd3-42db-8ffb-0e482e29c2dd]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:32 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc Nov 03 13:14:32 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:32 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" returned: 0 in 0.379s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:32 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc Nov 03 13:14:32 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:32 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-10bb6e6b-2d4d-4ad5-8961-164dd53098cc" released by "delete_volume" :: held 0.704s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Created reservations ['a2efe23e-7824-49af-aac2-b01027c25098', 'bf4a1ccd-6a8e-440d-b971-849bb51b6301', '1ae18bfd-1b4c-4435-9bbb-b18d7fd2d16e', '88773bfd-9a1c-47ce-bfbb-42b716e43f78'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:33 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:33 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:33 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:14:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4077f9ce-66a1-403c-bcee-01eab3fe7eb5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-10bb6e6b-2d4d-4ad5-8961-164dd53098cc-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (5d05e98b-99d2-42ad-ab7f-fe29e5475c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bed410f-8b4e-4824-9de3-b4003a38ce36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bed410f-8b4e-4824-9de3-b4003a38ce36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213470925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:34Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967e7f36-1f69-4543-bcf7-934f65e995db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967e7f36-1f69-4543-bcf7-934f65e995db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77517bd0-f342-4432-8aa7-bdcaf37e5e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77517bd0-f342-4432-8aa7-bdcaf37e5e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f', 'volume_name': 'volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7696279b-f9d0-4707-8e2c-030bb726a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7696279b-f9d0-4707-8e2c-030bb726a536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de01772-efcb-4c4b-8078-98c19230ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Volume 8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f', 'volume_size': 1} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213470925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:34Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Creating volume 8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:34 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f 1073741824 Nov 03 13:14:34 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:34 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f 1073741824" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:34 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f Nov 03 13:14:34 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:34 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de01772-efcb-4c4b-8078-98c19230ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8fa525-cc38-42e5-ad43-097f69663bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Volume volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f (8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f): created successfully Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8fa525-cc38-42e5-ad43-097f69663bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (5d05e98b-99d2-42ad-ab7f-fe29e5475c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2863e2ab-cf1b-4c9e-92f0-8beffb6e545b tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:14:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot 4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 of volume 8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca77af9-d2ac-4a7a-99af-9f16eea3db92]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:36 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f Nov 03 13:14:36 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:36 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:36 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 1G Nov 03 13:14:36 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:37 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 1G" returned: 0 in 0.483s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:37 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 Nov 03 13:14:37 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:37 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:37 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 is being set with open permissions: ugo+rw Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:37 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 Nov 03 13:14:37 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:37 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:37 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.info Nov 03 13:14:37 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (4fdac08c-3f54-4ba4-bb38-3d21c45a58ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e4435c-54b1-4acd-b5dd-b85f6d0b0e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e4435c-54b1-4acd-b5dd-b85f6d0b0e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901272269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619ea302-5cec-48ad-a0a0-43cbc46ee143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:38Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134709d3-4ffc-4ef3-9750-6435c67d4016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134709d3-4ffc-4ef3-9750-6435c67d4016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab2b66c-8db5-4316-b0fe-820ec896164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab2b66c-8db5-4316-b0fe-820ec896164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619ea302-5cec-48ad-a0a0-43cbc46ee143', 'volume_name': 'volume-619ea302-5cec-48ad-a0a0-43cbc46ee143', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea7c324-5c0d-4c70-b3f3-46bb9536240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea7c324-5c0d-4c70-b3f3-46bb9536240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e19a53-b408-4f58-9b77-132096c260ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Volume 619ea302-5cec-48ad-a0a0-43cbc46ee143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619ea302-5cec-48ad-a0a0-43cbc46ee143', 'volume_size': 1} Nov 03 13:14:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:38 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.info" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:38 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.info is being set with open permissions: ugo+rw Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:38 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.info Nov 03 13:14:38 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:38 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.info" returned: 0 in 0.253s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901272269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619ea302-5cec-48ad-a0a0-43cbc46ee143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:38Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Creating volume 619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:38 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 1073741824 Nov 03 13:14:38 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ec9dbdd8-527c-43df-9d58-e3ce435391d4 tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:14:38 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 1073741824" returned: 0 in 0.476s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:38 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 Nov 03 13:14:38 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:39 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e19a53-b408-4f58-9b77-132096c260ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619ea302-5cec-48ad-a0a0-43cbc46ee143', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e618aa-0299-4466-a970-3ac596005ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Volume volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 (619ea302-5cec-48ad-a0a0-43cbc46ee143): created successfully Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e618aa-0299-4466-a970-3ac596005ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (4fdac08c-3f54-4ba4-bb38-3d21c45a58ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a1cfebfd-9fe1-4b33-8b64-026e05de2253 tempest-ProjectReaderTests-638102560 None] Created volume successfully. Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot 4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 of volume 8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[406d3e34-32be-448c-a712-f3d203fa2513]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:39 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 Nov 03 13:14:39 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:39 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" returned: 0 in 0.367s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc7fd7b-271f-490c-8107-1611c7b8b4c6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:39 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f Nov 03 13:14:39 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Creating offline snapshot 29713077-51eb-4829-bf31-64c03904110e of volume 619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e8c7f-56c4-4434-a0a8-8592c08af606]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:40 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" returned: 0 in 0.396s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:40 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 Nov 03 13:14:40 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:40 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 Nov 03 13:14:40 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:40 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:40 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e 1G Nov 03 13:14:40 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:40 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:40 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51 Nov 03 13:14:40 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:40 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f.4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51" released by "_delete_snapshot" :: held 1.546s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" released by "delete_snapshot" :: held 1.573s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Created reservations ['8d4fac4f-1e57-40f6-b08a-46607731a498', '237c191d-9aba-4f00-b46d-d966614c56f8', '45456819-f162-422a-977a-2d875b2e0a44', 'c37b79a8-a1b4-46f1-ba8e-41b9a28d642e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-256253c6-ab78-4af8-b5ea-23667e374894 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-4ce66151-a21d-40c0-aaa3-b1ed0f7a1a51-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:41 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e 1G" returned: 0 in 0.521s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:41 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e Nov 03 13:14:41 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:41 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:41 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e is being set with open permissions: ugo+rw Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:41 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e Nov 03 13:14:41 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8430df-5445-4838-9523-cea04f02bafc]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:41 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:41 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.info Nov 03 13:14:41 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:41 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f Nov 03 13:14:41 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:42 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.info" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.info is being set with open permissions: ugo+rw Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:42 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" returned: 0 in 0.413s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:42 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.info Nov 03 13:14:42 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:42 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f Nov 03 13:14:42 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:42 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.info" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f" released by "delete_volume" :: held 0.818s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6b98b08e-597a-4240-910d-6d34bfef28fa tempest-ProjectReaderTests-638102560 None] Create snapshot completed successfully Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Created reservations ['04617494-4e2e-4990-b32b-b0e14b08ce06', '692a9e74-8bf9-4ffe-b01b-f4a5a5687d33', '506af1ac-1968-472e-a172-3e06bf0276b2', '4d6538bd-4da2-47dc-abc5-fece28366edf'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:42 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:42 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:42 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:14:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d7eb57e3-2c45-46dd-81e8-e1edba69e485 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-8072093a-6d3d-4c2b-a125-c2cbe0ca9e8f-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (684c2592-d974-4dfe-8967-02fc7ac42f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7641abc-53af-42c8-897b-ec03d9e64f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7641abc-53af-42c8-897b-ec03d9e64f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796932943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ab684d-c91c-4f6f-85ad-4f71b963a487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:43Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751fad71-ab09-4e07-9f27-6d83ca8dd298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751fad71-ab09-4e07-9f27-6d83ca8dd298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b19f23-acb9-4d92-a7f9-4c655d5be0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b19f23-acb9-4d92-a7f9-4c655d5be0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ab684d-c91c-4f6f-85ad-4f71b963a487', 'volume_name': 'volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d12c5-4eec-41c0-8287-8de7aee1e162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d12c5-4eec-41c0-8287-8de7aee1e162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f160f3ab-8edf-4dde-a26f-e0c698061520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Volume d0ab684d-c91c-4f6f-85ad-4f71b963a487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487', 'volume_size': 1} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796932943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ab684d-c91c-4f6f-85ad-4f71b963a487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:43Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Creating volume d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:43 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:43 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 1073741824 Nov 03 13:14:43 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-29713077-51eb-4829-bf31-64c03904110e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Lock "cinder-29713077-51eb-4829-bf31-64c03904110e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-619ea302-5cec-48ad-a0a0-43cbc46ee143" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-619ea302-5cec-48ad-a0a0-43cbc46ee143" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-29713077-51eb-4829-bf31-64c03904110e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-29713077-51eb-4829-bf31-64c03904110e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Deleting offline snapshot 29713077-51eb-4829-bf31-64c03904110e of volume 619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] snapshot_file for this snap is: volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9094e26-f09f-4fdc-b488-1681244c9bba]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:43 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e Nov 03 13:14:43 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:43 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 1073741824" returned: 0 in 0.555s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:43 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 Nov 03 13:14:43 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:44 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e" returned: 0 in 0.436s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-619ea302-5cec-48ad-a0a0-43cbc46ee143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4119cbf-2817-486a-898e-99a43cf869ec]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:44 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:44 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:44 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f160f3ab-8edf-4dde-a26f-e0c698061520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334d3969-eb73-4939-bb5d-ebbbd917887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Volume volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 (d0ab684d-c91c-4f6f-85ad-4f71b963a487): created successfully Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334d3969-eb73-4939-bb5d-ebbbd917887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (684c2592-d974-4dfe-8967-02fc7ac42f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b0b04af2-2ff2-4283-acc7-f6cd3f73c13b tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:14:44 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:44 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e Nov 03 13:14:44 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:44 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e" returned: 0 in 0.380s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:44 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e Nov 03 13:14:44 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:45 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143.29713077-51eb-4829-bf31-64c03904110e" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-29713077-51eb-4829-bf31-64c03904110e" released by "_delete_snapshot" :: held 1.633s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-619ea302-5cec-48ad-a0a0-43cbc46ee143" released by "delete_snapshot" :: held 1.663s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Created reservations ['9bb55f64-bce6-4c64-b276-ce448289d863', '294ed770-8be9-4350-bab3-1880cb116e32', '4bed2962-3019-400b-877d-a690eaf49db7', '0e01daf0-6947-4867-95d9-2dc7e286e739'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Delete snapshot completed successfully. Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14443598-7efa-44f3-9e9f-425ded85ab9d tempest-ProjectReaderTests-638102560 None] Lock "cinder-29713077-51eb-4829-bf31-64c03904110e-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot edd504b8-cbfa-49b4-bc33-f3590f85ed2f of volume d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d38f0f4-042b-4929-a99a-193e7520cbb7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-619ea302-5cec-48ad-a0a0-43cbc46ee143-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:45 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 Nov 03 13:14:45 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Lock "cinder-619ea302-5cec-48ad-a0a0-43cbc46ee143-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-619ea302-5cec-48ad-a0a0-43cbc46ee143" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-619ea302-5cec-48ad-a0a0-43cbc46ee143" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53474bf0-0dd5-4f38-8883-ad2c022023d6]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:45 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 Nov 03 13:14:45 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:45 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f 1G Nov 03 13:14:46 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143 Nov 03 13:14:46 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f 1G" returned: 0 in 0.476s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f Nov 03 13:14:46 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-619ea302-5cec-48ad-a0a0-43cbc46ee143" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-619ea302-5cec-48ad-a0a0-43cbc46ee143" released by "delete_volume" :: held 0.820s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Created reservations ['ec3b1e42-363e-4a6e-80dc-787effccba36', '0f694f12-94cb-4015-9c9a-1c89e01b4b39', '0bb2ced9-a2ff-4e86-86c0-d06286c06265', 'e667291d-a7de-4d8d-b05b-d5650082413c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:46 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:46 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f" returned: 0 in 0.375s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:46 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f is being set with open permissions: ugo+rw Nov 03 13:14:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:46 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f Nov 03 13:14:46 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Deleted volume successfully. Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6699c368-b23c-4df0-8618-2697baa6ba22 tempest-ProjectReaderTests-638102560 None] Lock "cinder-619ea302-5cec-48ad-a0a0-43cbc46ee143-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:47 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.info Nov 03 13:14:47 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (f09d5537-fd03-473a-8916-a8b7186be349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4dfeff-15f8-446e-84df-30cb26522895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4dfeff-15f8-446e-84df-30cb26522895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912177276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353ee0f1-f578-4f5c-8e51-4b78cc58a36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:47Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a3cf95-8c76-41a9-ac6a-3271f4cc69b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a3cf95-8c76-41a9-ac6a-3271f4cc69b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82846de7-ce37-471c-8f4b-2277b74eaeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82846de7-ce37-471c-8f4b-2277b74eaeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353ee0f1-f578-4f5c-8e51-4b78cc58a36a', 'volume_name': 'volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cc8997-133a-4b2f-8b4b-30bf0de7fd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cc8997-133a-4b2f-8b4b-30bf0de7fd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f8951e-6ee6-4b92-900c-8db9636d89eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Volume 353ee0f1-f578-4f5c-8e51-4b78cc58a36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a', 'volume_size': 1} Nov 03 13:14:47 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.info" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.info is being set with open permissions: ugo+rw Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.info Nov 03 13:14:47 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.info" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912177276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353ee0f1-f578-4f5c-8e51-4b78cc58a36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:47Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Creating volume 353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:47 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:47 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a 1073741824 Nov 03 13:14:47 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9442af79-20af-4954-9eda-a16938e445c0 tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:14:48 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a 1073741824" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:48 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a Nov 03 13:14:48 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:48 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f8951e-6ee6-4b92-900c-8db9636d89eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4cd323-2a85-4245-963c-97f27826588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Volume volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a (353ee0f1-f578-4f5c-8e51-4b78cc58a36a): created successfully Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4cd323-2a85-4245-963c-97f27826588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (f09d5537-fd03-473a-8916-a8b7186be349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0bedd75d-11ae-451e-8b10-648d541e7c80 tempest-ProjectReaderTests-638102560 None] Created volume successfully. Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-edd504b8-cbfa-49b4-bc33-f3590f85ed2f-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-edd504b8-cbfa-49b4-bc33-f3590f85ed2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-d0ab684d-c91c-4f6f-85ad-4f71b963a487" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-d0ab684d-c91c-4f6f-85ad-4f71b963a487" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-edd504b8-cbfa-49b4-bc33-f3590f85ed2f" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-edd504b8-cbfa-49b4-bc33-f3590f85ed2f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot edd504b8-cbfa-49b4-bc33-f3590f85ed2f of volume d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e0fe5-22d0-4025-89bc-7ef2f7ba9d85]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:48 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f Nov 03 13:14:48 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:49 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f" returned: 0 in 0.429s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff17f6e-58b2-44d6-b7ce-921dde7b9bb2]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:49 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 Nov 03 13:14:49 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Creating offline snapshot 4db1ef7f-453e-4ccb-8018-7e0615e37ba6 of volume 353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:49 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf30c83-e5ab-4b57-af0c-d44da88bc03a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:49 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f Nov 03 13:14:49 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:49 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a Nov 03 13:14:49 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:50 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f" returned: 0 in 0.376s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:50 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f Nov 03 13:14:50 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:50 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:50 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 1G Nov 03 13:14:50 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:50 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487.edd504b8-cbfa-49b4-bc33-f3590f85ed2f" returned: 0 in 0.286s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-edd504b8-cbfa-49b4-bc33-f3590f85ed2f" released by "_delete_snapshot" :: held 1.652s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-d0ab684d-c91c-4f6f-85ad-4f71b963a487" released by "delete_snapshot" :: held 1.683s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Created reservations ['35a16ad9-a5ac-4adb-ba07-dc2cea9ffa2d', '3286ecb2-7d04-411c-94a0-10400852486b', '4bd6750f-f833-4361-86cb-394ab2bfd9f7', '19031e0e-5ee9-46ef-aa63-4e884eaa2294'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1df9957-ea2c-426a-a06d-5bffda516077 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-edd504b8-cbfa-49b4-bc33-f3590f85ed2f-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:50 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 1G" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:50 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 Nov 03 13:14:50 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-d0ab684d-c91c-4f6f-85ad-4f71b963a487-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-d0ab684d-c91c-4f6f-85ad-4f71b963a487-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-d0ab684d-c91c-4f6f-85ad-4f71b963a487" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-d0ab684d-c91c-4f6f-85ad-4f71b963a487" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:51 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:51 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 is being set with open permissions: ugo+rw Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765258e-becc-4ea2-83b4-9a27ddb0f808]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:51 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 Nov 03 13:14:51 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:51 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 Nov 03 13:14:51 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:51 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:51 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.info Nov 03 13:14:51 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:51 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487" returned: 0 in 0.452s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:51 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487 Nov 03 13:14:51 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:51 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.info" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:51 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.info is being set with open permissions: ugo+rw Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:51 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.info Nov 03 13:14:51 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:51 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-d0ab684d-c91c-4f6f-85ad-4f71b963a487" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-d0ab684d-c91c-4f6f-85ad-4f71b963a487" released by "delete_volume" :: held 0.845s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Created reservations ['0288ee75-3a92-4847-8300-45ed9f39b7a3', 'dfc7339f-d602-4a9c-881a-cd9fe533ccf8', 'efcb9cb6-966b-4e7b-94be-de25233b30ae', 'ca1c7340-82ed-448e-b07a-1f4e83f86836'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:51 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.info" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-916efb9a-6390-4de1-90c5-e51abd6a125d tempest-ProjectReaderTests-638102560 None] Create snapshot completed successfully Nov 03 13:14:52 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:52 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:52 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6c5b0c6-d452-4459-8a92-bf1a5b1cf305 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-d0ab684d-c91c-4f6f-85ad-4f71b963a487-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (9e88ce9e-daae-468c-b70a-42a2efebfb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d03a2e4-4c1c-4afb-9af6-a0e317197beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d03a2e4-4c1c-4afb-9af6-a0e317197beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204619031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:53Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d934355-7b7d-4f2c-b52b-62e412c4f6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d934355-7b7d-4f2c-b52b-62e412c4f6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaf14cd-5fb7-41ff-a84e-a58b6a743dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaf14cd-5fb7-41ff-a84e-a58b6a743dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d', 'volume_name': 'volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf62bfa-40c2-4c3e-ae6c-a36e00278da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf62bfa-40c2-4c3e-ae6c-a36e00278da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b38a7df-5e6d-4bed-a7ac-80c87baf512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Volume 7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d', 'volume_size': 1} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204619031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:53Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Creating volume 7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:52 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:52 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d 1073741824 Nov 03 13:14:52 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-4db1ef7f-453e-4ccb-8018-7e0615e37ba6-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Lock "cinder-4db1ef7f-453e-4ccb-8018-7e0615e37ba6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-4db1ef7f-453e-4ccb-8018-7e0615e37ba6" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-4db1ef7f-453e-4ccb-8018-7e0615e37ba6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Deleting offline snapshot 4db1ef7f-453e-4ccb-8018-7e0615e37ba6 of volume 353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] snapshot_file for this snap is: volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc99d464-3bdf-4a04-9717-1b93b07b5e96]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:53 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 Nov 03 13:14:53 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:53 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d 1073741824" returned: 0 in 0.450s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:53 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d Nov 03 13:14:53 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:53 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[30202ec5-2bf5-4a95-90c5-e0bf3c1c3a47]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:53 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b38a7df-5e6d-4bed-a7ac-80c87baf512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b27978-8e77-4166-bdef-ad88de87fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Volume volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d (7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d): created successfully Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b27978-8e77-4166-bdef-ad88de87fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (9e88ce9e-daae-468c-b70a-42a2efebfb5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d331b856-bc6e-4eb2-8a4f-990a9642d422 tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:14:53 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a Nov 03 13:14:53 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot e0d2162b-8d70-4a0b-bd89-cce52fe01670 of volume 7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af80eb-a3c1-42a4-903e-4037eedcd90c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:53 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" returned: 0 in 0.403s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:53 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 Nov 03 13:14:53 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:53 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d Nov 03 13:14:53 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:54 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6" returned: 0 in 0.349s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:54 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:54 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6 Nov 03 13:14:54 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:54 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 1G Nov 03 13:14:54 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:54 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a.4db1ef7f-453e-4ccb-8018-7e0615e37ba6" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-4db1ef7f-453e-4ccb-8018-7e0615e37ba6" released by "_delete_snapshot" :: held 1.513s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" released by "delete_snapshot" :: held 1.537s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Created reservations ['1337c27e-ef7d-473d-98a0-54683e880953', '3507c1f9-6ce0-41cb-9ea3-d1f54e375a79', 'de05b6eb-2136-4455-9eef-504956002277', '33a10b57-8c15-4582-84ee-dcef3974cefd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Delete snapshot completed successfully. Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7df7526c-3b44-4557-854f-658a8a1444f3 tempest-ProjectReaderTests-638102560 None] Lock "cinder-4db1ef7f-453e-4ccb-8018-7e0615e37ba6-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:54 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 1G" returned: 0 in 0.436s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:54 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 Nov 03 13:14:54 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:54 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:54 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 is being set with open permissions: ugo+rw Nov 03 13:14:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:54 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 Nov 03 13:14:54 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-353ee0f1-f578-4f5c-8e51-4b78cc58a36a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Lock "cinder-353ee0f1-f578-4f5c-8e51-4b78cc58a36a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:55 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed53be3-4252-40ca-b6f0-1f8a395740ca]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:55 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.info Nov 03 13:14:55 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:55 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a Nov 03 13:14:55 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:55 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.info" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:55 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.info is being set with open permissions: ugo+rw Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:55 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.info Nov 03 13:14:55 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:55 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:55 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a Nov 03 13:14:55 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:55 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.info" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-040ac383-f473-4544-b1ef-aaceb81910ed tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:14:55 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-353ee0f1-f578-4f5c-8e51-4b78cc58a36a" released by "delete_volume" :: held 0.706s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Created reservations ['c0194ca5-a9d3-45c6-a5d8-316a60b69e20', '17daf41d-c1ee-43a2-9c0f-74fc9143ab96', 'be19bb01-da9d-4559-b208-a1fbaea1e763', 'ecdedcc5-0252-4695-9ca7-63817935a560'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-e0d2162b-8d70-4a0b-bd89-cce52fe01670-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-e0d2162b-8d70-4a0b-bd89-cce52fe01670-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-e0d2162b-8d70-4a0b-bd89-cce52fe01670" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-e0d2162b-8d70-4a0b-bd89-cce52fe01670" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot e0d2162b-8d70-4a0b-bd89-cce52fe01670 of volume 7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fd025d-d556-41ed-8b01-f76b9cee52c4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:56 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:56 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:56 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 Nov 03 13:14:56 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:56 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Deleted volume successfully. Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a135f808-b84b-4a58-8e57-9a2faf0b0e39 tempest-ProjectReaderTests-638102560 None] Lock "cinder-353ee0f1-f578-4f5c-8e51-4b78cc58a36a-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:56 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[18db9e58-6a4c-4020-aa53-1ec80144010d]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:56 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d Nov 03 13:14:56 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (1c84deee-fb4d-4f20-80b1-0feada639fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941a8d12-f380-495a-89c8-12c7bfc7340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941a8d12-f380-495a-89c8-12c7bfc7340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738859477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0313a86d-a5d8-4dcf-a8b7-17c6093742b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:57Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64052f21-94f6-417d-a1cf-1c9e3aeb3091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64052f21-94f6-417d-a1cf-1c9e3aeb3091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7d0ec0-e8dc-45d2-8264-092501bd5182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7d0ec0-e8dc-45d2-8264-092501bd5182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0313a86d-a5d8-4dcf-a8b7-17c6093742b5', 'volume_name': 'volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf886a27-0d7e-4996-8282-1643c5a3662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf886a27-0d7e-4996-8282-1643c5a3662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eef1aa9-d706-436c-9c01-467353aa52e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Volume 0313a86d-a5d8-4dcf-a8b7-17c6093742b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5', 'volume_size': 1} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738859477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0313a86d-a5d8-4dcf-a8b7-17c6093742b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:14:57Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Creating volume 0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:14:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:56 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 1073741824 Nov 03 13:14:56 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:56 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" returned: 0 in 0.396s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:56 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 Nov 03 13:14:56 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:57 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:57 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670 Nov 03 13:14:57 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:57 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 1073741824" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:57 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 Nov 03 13:14:57 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:57 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d.e0d2162b-8d70-4a0b-bd89-cce52fe01670" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-e0d2162b-8d70-4a0b-bd89-cce52fe01670" released by "_delete_snapshot" :: held 1.545s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" released by "delete_snapshot" :: held 1.579s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:57 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eef1aa9-d706-436c-9c01-467353aa52e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d52e0a0-c37d-43cf-8561-2f653f375967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Created reservations ['d2f5db3a-49a7-4e85-841c-bba88a746431', 'b7be43af-9620-44ea-87d6-aa0d1b4ee68d', '7e8810ac-0168-4f0c-a218-a09eb55add8f', '1e79164f-8c60-413a-925b-a11e0cf408ed'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Volume volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 (0313a86d-a5d8-4dcf-a8b7-17c6093742b5): created successfully Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d52e0a0-c37d-43cf-8561-2f653f375967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (1c84deee-fb4d-4f20-80b1-0feada639fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-87601860-4b20-41a0-8a4e-8cd40ae58610 tempest-ProjectReaderTests-638102560 None] Created volume successfully. Nov 03 13:14:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:14:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-74a595f6-3b6e-41d0-9482-f018145cc2d5 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-e0d2162b-8d70-4a0b-bd89-cce52fe01670-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Lock "cinder-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f7179a-09e4-4ca7-ba66-bbe064d53d7c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:58 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d Nov 03 13:14:58 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:58 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:58 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d Nov 03 13:14:58 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:58 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d" released by "delete_volume" :: held 0.690s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:58 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:58 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Created reservations ['d2e2f3e7-98ac-4b07-a568-36b174f93a3a', '7b3f9971-ee63-47f5-96ef-48189c383e6f', 'ef512eeb-43f1-4351-b50a-9bab5669849d', '2ea8f9e5-972a-4f64-9ed3-40293ee2dfa2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Creating offline snapshot ba4ea54f-9304-4399-8691-41cb582fa9f6 of volume 0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc2864-b9c7-4b00-a368-c8d4950116fc]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:14:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:59 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:59 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:14:59 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:14:59 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 Nov 03 13:14:59 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:59 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:14:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-76e2daa2-e6a0-4ff4-a9ac-56cf8c77c4ff tempest-ProjectMemberTests-1686242941 None] Lock "cinder-7eb9bdf4-e998-43dd-b5a7-ad60fc841c1d-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:14:59 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:59 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 1G Nov 03 13:14:59 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (a5521259-08c8-4193-a4d9-fa0bf367f0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010ac3e0-a5a6-49b2-99e7-19c8d8873e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010ac3e0-a5a6-49b2-99e7-19c8d8873e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843384559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4748f4f-6737-4f47-8574-94529f3a8565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:00Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e328b89-6fc1-4bf9-8108-81ad66d13484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e328b89-6fc1-4bf9-8108-81ad66d13484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28faaec0-e2ed-467f-a81c-5e625756ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28faaec0-e2ed-467f-a81c-5e625756ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4748f4f-6737-4f47-8574-94529f3a8565', 'volume_name': 'volume-b4748f4f-6737-4f47-8574-94529f3a8565', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0898e8-2387-47cb-b074-a3b4a3a81fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0898e8-2387-47cb-b074-a3b4a3a81fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f86d103-dc52-4175-9aef-12db82a31b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:14:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Volume b4748f4f-6737-4f47-8574-94529f3a8565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4748f4f-6737-4f47-8574-94529f3a8565', 'volume_size': 1} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:14:59 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 1G" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:14:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:14:59 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 Nov 03 13:14:59 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:00 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:00 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 is being set with open permissions: ugo+rw Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:00 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 Nov 03 13:15:00 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:00 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:00 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.info Nov 03 13:15:00 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:00 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.info" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:00 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.info is being set with open permissions: ugo+rw Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:00 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.info Nov 03 13:15:00 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:00 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.info" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843384559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4748f4f-6737-4f47-8574-94529f3a8565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:00Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Creating volume b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:00 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:15:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:00 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 1073741824 Nov 03 13:15:00 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8ce8b590-1d0b-44b4-a2c9-1052e0b65d98 tempest-ProjectReaderTests-638102560 None] Create snapshot completed successfully Nov 03 13:15:01 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 1073741824" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:01 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 Nov 03 13:15:01 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:01 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565" returned: 0 in 0.236s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f86d103-dc52-4175-9aef-12db82a31b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4748f4f-6737-4f47-8574-94529f3a8565', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964e745a-2123-4edc-a718-b8575bce6a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:01 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Volume volume-b4748f4f-6737-4f47-8574-94529f3a8565 (b4748f4f-6737-4f47-8574-94529f3a8565): created successfully Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964e745a-2123-4edc-a718-b8575bce6a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (a5521259-08c8-4193-a4d9-fa0bf367f0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-94b3e5a6-0aa8-4a83-a2c4-8ffb5438ee22 tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-ba4ea54f-9304-4399-8691-41cb582fa9f6-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Lock "cinder-ba4ea54f-9304-4399-8691-41cb582fa9f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-ba4ea54f-9304-4399-8691-41cb582fa9f6" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-ba4ea54f-9304-4399-8691-41cb582fa9f6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Deleting offline snapshot ba4ea54f-9304-4399-8691-41cb582fa9f6 of volume 0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] snapshot_file for this snap is: volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3feb18-8230-4b10-8bb6-e269ae32f688]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 Nov 03 13:15:02 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:02 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[959cd0b4-0972-414c-aedf-8c0d849378f5]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 Nov 03 13:15:02 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot 9bcfa24c-46fa-4f56-ac18-454b373d36de of volume b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:02 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cfcb0f-8d7f-4d42-bdd4-e2a896af88fe]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:02 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 Nov 03 13:15:02 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:03 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 Nov 03 13:15:03 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:03 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:03 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6 Nov 03 13:15:03 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:03 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:03 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de 1G Nov 03 13:15:03 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:03 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5.ba4ea54f-9304-4399-8691-41cb582fa9f6" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-ba4ea54f-9304-4399-8691-41cb582fa9f6" released by "_delete_snapshot" :: held 1.468s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" released by "delete_snapshot" :: held 1.494s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Created reservations ['99cee368-641b-41a8-a733-45de4182e19d', '4f51a694-98ee-445b-ba25-3b7c26d5c872', 'd712102f-59f8-42ce-a871-66446427b8cb', '42b11bb4-c801-40ec-889c-fec168fb79bd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Delete snapshot completed successfully. Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-38605a4c-bd4a-47be-adf6-6596c2743830 tempest-ProjectReaderTests-638102560 None] Lock "cinder-ba4ea54f-9304-4399-8691-41cb582fa9f6-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:03 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de 1G" returned: 0 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4748f4f-6737-4f47-8574-94529f3a8565 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:03 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4748f4f-6737-4f47-8574-94529f3a8565 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de Nov 03 13:15:03 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4748f4f-6737-4f47-8574-94529f3a8565 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:04 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de is being set with open permissions: ugo+rw Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:04 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de Nov 03 13:15:04 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-0313a86d-a5d8-4dcf-a8b7-17c6093742b5-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Lock "cinder-0313a86d-a5d8-4dcf-a8b7-17c6093742b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:04 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[39326f09-5550-4a06-aa3f-45913c838245]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:04 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.info Nov 03 13:15:04 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 Nov 03 13:15:04 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.info" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:04 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.info is being set with open permissions: ugo+rw Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:04 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.info Nov 03 13:15:04 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:04 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5 Nov 03 13:15:04 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:04 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.info" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-98c442fa-4b77-4021-a821-28f143a263d4 tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:15:05 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-0313a86d-a5d8-4dcf-a8b7-17c6093742b5" released by "delete_volume" :: held 0.733s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-9bcfa24c-46fa-4f56-ac18-454b373d36de-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Created reservations ['19610cbb-49d1-4274-9ab8-76128e2f0001', '81d60a69-c9cf-4e01-a6e8-f71875806549', 'da680639-56ef-4d5f-9ccf-513c6ea4b98a', '660d8fb7-cbf0-4001-bfc2-1d70fd9843df'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-9bcfa24c-46fa-4f56-ac18-454b373d36de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-b4748f4f-6737-4f47-8574-94529f3a8565" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-b4748f4f-6737-4f47-8574-94529f3a8565" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-9bcfa24c-46fa-4f56-ac18-454b373d36de" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-9bcfa24c-46fa-4f56-ac18-454b373d36de" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot 9bcfa24c-46fa-4f56-ac18-454b373d36de of volume b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[303790bf-9ee7-42ea-965a-81b0da0337d0]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:15:05 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de Nov 03 13:15:05 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.254s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Deleted volume successfully. Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4aeb7af3-be9d-48c4-9c22-7b9dd5c8ea23 tempest-ProjectReaderTests-638102560 None] Lock "cinder-0313a86d-a5d8-4dcf-a8b7-17c6093742b5-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:05 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de" returned: 0 in 0.413s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4748f4f-6737-4f47-8574-94529f3a8565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d87406-2bfb-4c5d-8c87-c0fa65187c31]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:05 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 Nov 03 13:15:05 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (b5663074-3093-4905-ace5-583974bd4d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daccb67-a00a-445c-8d1e-e536b53d497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daccb67-a00a-445c-8d1e-e536b53d497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834038422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc9da27-c753-40c4-84f9-c2836046de8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:06Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b376a84-d146-436a-82b7-06ce283bf92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b376a84-d146-436a-82b7-06ce283bf92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46c8c09-26ff-4f13-8764-69bb870ab67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46c8c09-26ff-4f13-8764-69bb870ab67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc9da27-c753-40c4-84f9-c2836046de8a', 'volume_name': 'volume-4fc9da27-c753-40c4-84f9-c2836046de8a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a909381-a580-481f-98f2-452b581fb814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a909381-a580-481f-98f2-452b581fb814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d711fd-f3e9-4e23-90c2-502cc34fea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Volume 4fc9da27-c753-40c4-84f9-c2836046de8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc9da27-c753-40c4-84f9-c2836046de8a', 'volume_size': 1} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834038422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc9da27-c753-40c4-84f9-c2836046de8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:06Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Creating volume 4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:15:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a 1073741824 Nov 03 13:15:06 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de Nov 03 13:15:06 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de Nov 03 13:15:06 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a 1073741824" returned: 0 in 0.477s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:06 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a Nov 03 13:15:06 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:06 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565.9bcfa24c-46fa-4f56-ac18-454b373d36de" returned: 0 in 0.244s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-9bcfa24c-46fa-4f56-ac18-454b373d36de" released by "_delete_snapshot" :: held 1.513s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-b4748f4f-6737-4f47-8574-94529f3a8565" released by "delete_snapshot" :: held 1.539s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:06 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d711fd-f3e9-4e23-90c2-502cc34fea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc9da27-c753-40c4-84f9-c2836046de8a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92931f9-e660-472e-a1ac-63eff8030dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Created reservations ['9e163c98-26e5-4429-927b-7279fec95457', '2bb16284-c717-4492-a80b-9a2232932239', '294da894-5c3c-483c-a54c-b2ffa584c489', '2c8d8564-76ea-4044-983a-074d6ad94698'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Volume volume-4fc9da27-c753-40c4-84f9-c2836046de8a (4fc9da27-c753-40c4-84f9-c2836046de8a): created successfully Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92931f9-e660-472e-a1ac-63eff8030dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (b5663074-3093-4905-ace5-583974bd4d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9bf34f78-9924-4d62-adac-fca7c5f6d82d tempest-ProjectReaderTests-638102560 None] Created volume successfully. Nov 03 13:15:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:15:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-636307d5-48c6-4ae0-9cc1-348819836b23 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-9bcfa24c-46fa-4f56-ac18-454b373d36de-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-b4748f4f-6737-4f47-8574-94529f3a8565-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-b4748f4f-6737-4f47-8574-94529f3a8565-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-b4748f4f-6737-4f47-8574-94529f3a8565" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-b4748f4f-6737-4f47-8574-94529f3a8565" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ae4bb-bf4e-454d-a883-d6251e038455]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:07 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 Nov 03 13:15:07 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:07 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:07 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565 Nov 03 13:15:07 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:07 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-b4748f4f-6737-4f47-8574-94529f3a8565" returned: 0 in 0.253s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-b4748f4f-6737-4f47-8574-94529f3a8565" released by "delete_volume" :: held 0.672s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Created reservations ['2c606620-6c95-4733-a12f-8a2dd42bfc1d', 'e3674c52-26f4-4b1d-965a-d1558d21debb', '9fa1819d-274b-41d1-9e65-4e3e0aed0417', 'dc664d45-d489-476d-9f95-eb9c6ba65475'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:08 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:15:08 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:08 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Creating offline snapshot b3e7ad83-cdae-4dad-9368-638efacaf997 of volume 4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54007d0b-3770-4515-a4d7-17387090d40b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-b4748f4f-6737-4f47-8574-94529f3a8565-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77c0564-6c3d-49e6-acab-22a1c3431368]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:08 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a Nov 03 13:15:08 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:08 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:08 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 1G Nov 03 13:15:08 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (b471f4fe-8ffa-4656-91de-01730ecef496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17eca7cd-ec89-4214-a08f-acfd309b457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17eca7cd-ec89-4214-a08f-acfd309b457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798466251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a420ac3-4b13-4986-a06c-b2925193fa27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:09Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67525e0a-9849-44c6-8751-f2ab2b39a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67525e0a-9849-44c6-8751-f2ab2b39a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72267f56-f580-4341-96bc-dcc20b700ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72267f56-f580-4341-96bc-dcc20b700ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a420ac3-4b13-4986-a06c-b2925193fa27', 'volume_name': 'volume-5a420ac3-4b13-4986-a06c-b2925193fa27', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f3fc33-b811-4287-a980-7facd8c8832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f3fc33-b811-4287-a980-7facd8c8832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ea6759-ee1d-4f6a-8e88-a4f9abd09ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Volume 5a420ac3-4b13-4986-a06c-b2925193fa27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a420ac3-4b13-4986-a06c-b2925193fa27', 'volume_size': 1} Nov 03 13:15:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:09 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 1G" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc9da27-c753-40c4-84f9-c2836046de8a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc9da27-c753-40c4-84f9-c2836046de8a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 Nov 03 13:15:09 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:09 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc9da27-c753-40c4-84f9-c2836046de8a -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:09 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 is being set with open permissions: ugo+rw Nov 03 13:15:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 Nov 03 13:15:09 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:09 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997" returned: 0 in 0.246s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:09 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.info Nov 03 13:15:09 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.info" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.info is being set with open permissions: ugo+rw Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:10 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.info Nov 03 13:15:10 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.info" returned: 0 in 0.239s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798466251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a420ac3-4b13-4986-a06c-b2925193fa27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:09Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Creating volume 5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:10 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:10 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 1073741824 Nov 03 13:15:10 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9116ea18-0388-4f13-a643-3841e2ce7f70 tempest-ProjectReaderTests-638102560 None] Create snapshot completed successfully Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-b3e7ad83-cdae-4dad-9368-638efacaf997-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Lock "cinder-b3e7ad83-cdae-4dad-9368-638efacaf997-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-4fc9da27-c753-40c4-84f9-c2836046de8a" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-4fc9da27-c753-40c4-84f9-c2836046de8a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-b3e7ad83-cdae-4dad-9368-638efacaf997" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-b3e7ad83-cdae-4dad-9368-638efacaf997" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Deleting offline snapshot b3e7ad83-cdae-4dad-9368-638efacaf997 of volume 4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] snapshot_file for this snap is: volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b41df9-1ee9-4fda-ba89-d6bb6698ade7]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:10 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 Nov 03 13:15:10 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 1073741824" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:10 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 Nov 03 13:15:10 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:10 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fc9da27-c753-40c4-84f9-c2836046de8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f1bf02-6432-4e37-8c36-81daf8924e6b]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:11 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ea6759-ee1d-4f6a-8e88-a4f9abd09ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a420ac3-4b13-4986-a06c-b2925193fa27', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c8b361-764e-496d-8db4-9eb6ad35d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Volume volume-5a420ac3-4b13-4986-a06c-b2925193fa27 (5a420ac3-4b13-4986-a06c-b2925193fa27): created successfully Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c8b361-764e-496d-8db4-9eb6ad35d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (b471f4fe-8ffa-4656-91de-01730ecef496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-64508764-94b6-4760-b7d8-16f0e1a22bbf tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:15:11 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a Nov 03 13:15:11 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:11 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:11 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 Nov 03 13:15:11 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:11 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:11 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997 Nov 03 13:15:11 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:11 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a.b3e7ad83-cdae-4dad-9368-638efacaf997" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-b3e7ad83-cdae-4dad-9368-638efacaf997" released by "_delete_snapshot" :: held 1.445s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-4fc9da27-c753-40c4-84f9-c2836046de8a" released by "delete_snapshot" :: held 1.469s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Created reservations ['2cb490c1-c8ca-430f-beb1-ea02b9d6bdb6', 'cff3aa0d-3913-407d-a9fd-0e5656b93546', 'aaf9c927-0066-4005-90c4-33abdca38c0f', 'f4ac6cbb-a9ab-405b-a525-f59bb98cbb50'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Delete snapshot completed successfully. Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7f16602-0fae-4c08-8ff5-88d5ac00c763 tempest-ProjectReaderTests-638102560 None] Lock "cinder-b3e7ad83-cdae-4dad-9368-638efacaf997-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot 74343acd-2c23-467f-931f-7266759a902a of volume 5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa498f-aa67-4ec5-9c8e-759244f37e0f]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 Nov 03 13:15:12 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:12 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a 1G Nov 03 13:15:12 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-4fc9da27-c753-40c4-84f9-c2836046de8a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Lock "cinder-4fc9da27-c753-40c4-84f9-c2836046de8a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-4fc9da27-c753-40c4-84f9-c2836046de8a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-4fc9da27-c753-40c4-84f9-c2836046de8a" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[07964524-1f97-47c2-a89d-7532d56d0b27]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:12 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a Nov 03 13:15:12 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a 1G" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a420ac3-4b13-4986-a06c-b2925193fa27 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a420ac3-4b13-4986-a06c-b2925193fa27 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a Nov 03 13:15:13 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a Nov 03 13:15:13 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a420ac3-4b13-4986-a06c-b2925193fa27 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a is being set with open permissions: ugo+rw Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a Nov 03 13:15:13 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-4fc9da27-c753-40c4-84f9-c2836046de8a" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-4fc9da27-c753-40c4-84f9-c2836046de8a" released by "delete_volume" :: held 0.724s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Created reservations ['5a58c14f-90a3-444c-a2d8-be43282de287', '03bd4a11-9e8d-4548-940d-b196f391b4e2', '87706046-35eb-48d5-83eb-32ced04c9211', 'a45b577c-dc4a-43df-8606-bbf1ca0c583c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:15:13 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.info Nov 03 13:15:13 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:13 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Deleted volume successfully. Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4d05ecf-378c-443b-8765-c20d88e9f84c tempest-ProjectReaderTests-638102560 None] Lock "cinder-4fc9da27-c753-40c4-84f9-c2836046de8a-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:13 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.info" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:13 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.info is being set with open permissions: ugo+rw Nov 03 13:15:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:13 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.info Nov 03 13:15:13 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:14 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.info" returned: 0 in 0.261s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-78b46138-3358-4f19-9e4c-de155213a4c8 tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (35c9ccb2-2462-4c39-b8f8-a170c196d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dc226a-0d64-41db-a7ec-1225add9b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dc226a-0d64-41db-a7ec-1225add9b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114352988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f0ab1d-c07a-4bde-acab-1bbedccc0b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:14Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326a641d-48b5-4e1b-9d0f-e0960855073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326a641d-48b5-4e1b-9d0f-e0960855073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef472b24-cc59-4b0d-9bff-5efa3272a75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef472b24-cc59-4b0d-9bff-5efa3272a75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f0ab1d-c07a-4bde-acab-1bbedccc0b40', 'volume_name': 'volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e1f0c6-53c1-4209-9950-2200654858bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e1f0c6-53c1-4209-9950-2200654858bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ebe852-f2e5-46df-8bb1-5cbff2857767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Volume c3f0ab1d-c07a-4bde-acab-1bbedccc0b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40', 'volume_size': 1} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114352988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f0ab1d-c07a-4bde-acab-1bbedccc0b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385440651c254ee1824239e9dfae5200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:14Z,use_quota=True,user_id='e36ac2367b194b1d9ab253b53e1863fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Creating volume c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-74343acd-2c23-467f-931f-7266759a902a-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:14 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 1073741824 Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Lock "cinder-74343acd-2c23-467f-931f-7266759a902a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:14 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-5a420ac3-4b13-4986-a06c-b2925193fa27" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-5a420ac3-4b13-4986-a06c-b2925193fa27" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-74343acd-2c23-467f-931f-7266759a902a" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-74343acd-2c23-467f-931f-7266759a902a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot 74343acd-2c23-467f-931f-7266759a902a of volume 5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d044d-a64f-4456-be24-4134cb55cd3e]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:14 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a Nov 03 13:15:14 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:14 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 1073741824" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:14 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a" returned: 0 in 0.407s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a420ac3-4b13-4986-a06c-b2925193fa27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:14 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 Nov 03 13:15:14 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2004caee-1950-4d42-a934-3536e8d59408]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:15 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 Nov 03 13:15:15 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:15 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ebe852-f2e5-46df-8bb1-5cbff2857767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e983a65-146f-40dd-a321-d3b792c770ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Volume volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 (c3f0ab1d-c07a-4bde-acab-1bbedccc0b40): created successfully Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e983a65-146f-40dd-a321-d3b792c770ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Flow 'volume_create_manager' (35c9ccb2-2462-4c39-b8f8-a170c196d987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-426ea7f8-5577-4cdd-b12b-df4a27004423 tempest-ProjectReaderTests-638102560 None] Created volume successfully. Nov 03 13:15:15 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:15 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a Nov 03 13:15:15 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Creating offline snapshot 0c91308e-9ca2-4be5-8ef7-f6c010329a32 of volume c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[223b0b86-7f12-4c68-b1e3-edcddb8f8954]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:15 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 Nov 03 13:15:15 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:15 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a" returned: 0 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:15 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a Nov 03 13:15:15 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:15 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" returned: 0 in 0.396s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:15 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27.74343acd-2c23-467f-931f-7266759a902a" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:15 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 1G Nov 03 13:15:15 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-74343acd-2c23-467f-931f-7266759a902a" released by "_delete_snapshot" :: held 1.546s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-5a420ac3-4b13-4986-a06c-b2925193fa27" released by "delete_snapshot" :: held 1.568s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Created reservations ['40d52fbe-e081-4390-89d6-7a540d3e2c30', 'aa0751a2-b5e3-417d-ad76-9fc689071438', '7b5105f1-edde-4627-8503-a3aa49a050d0', '9c484eca-558e-4538-b674-e7688a272d15'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3227dfc4-5b97-411f-b905-aaf06b9911ee tempest-ProjectMemberTests-1686242941 None] Lock "cinder-74343acd-2c23-467f-931f-7266759a902a-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:16 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 1G" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:16 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 Nov 03 13:15:16 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-5a420ac3-4b13-4986-a06c-b2925193fa27-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-5a420ac3-4b13-4986-a06c-b2925193fa27-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-5a420ac3-4b13-4986-a06c-b2925193fa27" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-5a420ac3-4b13-4986-a06c-b2925193fa27" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:16 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:16 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 is being set with open permissions: ugo+rw Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[39164b96-c34a-444c-9a71-3e6b50639584]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:16 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 Nov 03 13:15:16 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:16 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 Nov 03 13:15:16 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:16 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:16 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.info Nov 03 13:15:16 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:17 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:17 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27 Nov 03 13:15:17 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:17 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.info" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:17 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.info is being set with open permissions: ugo+rw Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:17 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.info Nov 03 13:15:17 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:17 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-5a420ac3-4b13-4986-a06c-b2925193fa27" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-5a420ac3-4b13-4986-a06c-b2925193fa27" released by "delete_volume" :: held 0.707s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=217,cinder:INSERT=66,cinder:UPDATE=248,cinder:DELETE=19 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=197,cinder:INSERT=81,cinder:UPDATE=291,cinder:DELETE=24 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Created reservations ['8a6427a3-9d86-4d9e-b72c-f08b15958d52', '3a6a1839-aa80-4e5a-85bc-d4afaceab4ef', '61d18549-4c27-43ea-b13e-8cc29bddb2d8', '05230889-ffc5-4258-a36c-e925996d92e6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:17 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.info" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:17 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:15:17 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-915b10cf-722b-491a-b8d1-c4a0536fe867 tempest-ProjectReaderTests-638102560 None] Create snapshot completed successfully Nov 03 13:15:17 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:15:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2b6ca2b4-e85a-4b1c-8d87-d8e84c3d5fd7 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-5a420ac3-4b13-4986-a06c-b2925193fa27-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (510d764d-e8f2-4419-a6a2-be2d200d09d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8650069-f5af-4a51-ac06-ff794f81a4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8650069-f5af-4a51-ac06-ff794f81a4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1824674517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48be385-49fb-4603-a4b8-1c675b6e7e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:18Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d3f8d4-4b25-4701-bb42-66293761ea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d3f8d4-4b25-4701-bb42-66293761ea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236627dc-44d8-4d32-9b29-76f1d7e8e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236627dc-44d8-4d32-9b29-76f1d7e8e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48be385-49fb-4603-a4b8-1c675b6e7e75', 'volume_name': 'volume-e48be385-49fb-4603-a4b8-1c675b6e7e75', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418716ed-ca99-42d2-a334-6d393fa3dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418716ed-ca99-42d2-a334-6d393fa3dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855a4fef-bdea-4920-aa72-2878ff8ee5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Volume e48be385-49fb-4603-a4b8-1c675b6e7e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48be385-49fb-4603-a4b8-1c675b6e7e75', 'volume_size': 1} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1824674517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48be385-49fb-4603-a4b8-1c675b6e7e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc1300f0a9c4c5ba9bec79b2a31a574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:18Z,use_quota=True,user_id='33f7e9f2ab264c578631d63d1aee250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Creating volume e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:18 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 1073741824 Nov 03 13:15:18 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-0c91308e-9ca2-4be5-8ef7-f6c010329a32-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Lock "cinder-0c91308e-9ca2-4be5-8ef7-f6c010329a32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:18 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 1073741824" returned: 0 in 0.438s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-0c91308e-9ca2-4be5-8ef7-f6c010329a32" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-0c91308e-9ca2-4be5-8ef7-f6c010329a32" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Deleting offline snapshot 0c91308e-9ca2-4be5-8ef7-f6c010329a32 of volume c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] snapshot_file for this snap is: volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4916bc69-0f16-42af-824c-9d28e5c60026]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:18 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 Nov 03 13:15:18 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:18 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 Nov 03 13:15:18 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:19 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855a4fef-bdea-4920-aa72-2878ff8ee5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48be385-49fb-4603-a4b8-1c675b6e7e75', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0af690-d4fb-4766-9712-80cc8694de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Volume volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 (e48be385-49fb-4603-a4b8-1c675b6e7e75): created successfully Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0af690-d4fb-4766-9712-80cc8694de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Flow 'volume_create_manager' (510d764d-e8f2-4419-a6a2-be2d200d09d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dae92678-636a-4b76-8a74-0ba9971227dc tempest-ProjectMemberTests-1686242941 None] Created volume successfully. Nov 03 13:15:19 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba83728f-e037-4a7f-8b6f-724629c1c1c1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:19 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 Nov 03 13:15:19 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Creating offline snapshot d28e87b5-9e15-4faf-9961-de0879a99cfa of volume e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7817dc5-3482-4f5b-b7ec-55968d8ef49a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:19 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 Nov 03 13:15:19 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:19 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:19 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 Nov 03 13:15:19 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:19 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:19 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa 1G Nov 03 13:15:19 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:19 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32" returned: 0 in 0.343s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:19 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32 Nov 03 13:15:19 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:20 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa 1G" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:20 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40.0c91308e-9ca2-4be5-8ef7-f6c010329a32" returned: 0 in 0.286s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:20 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa Nov 03 13:15:20 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-0c91308e-9ca2-4be5-8ef7-f6c010329a32" released by "_delete_snapshot" :: held 1.517s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" released by "delete_snapshot" :: held 1.543s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Created reservations ['014d4496-a0fb-4128-befc-8d901bc9369b', 'c107fb47-29c4-4898-b7bb-357e932d23c5', 'ebff406d-04ce-4efc-a737-ffaf4422b764', '590a1ded-dfe8-4474-8d6c-6cb013178d32'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Delete snapshot completed successfully. Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f858f66-2132-4244-b66c-07ea6cc44914 tempest-ProjectReaderTests-638102560 None] Lock "cinder-0c91308e-9ca2-4be5-8ef7-f6c010329a32-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:20 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:20 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa is being set with open permissions: ugo+rw Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:20 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa Nov 03 13:15:20 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:20 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa" returned: 0 in 0.239s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:20 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.info Nov 03 13:15:20 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Lock "cinder-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Acquiring lock "cinder-quobyte-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[09020bda-c694-47dc-950b-b6f965a380f1]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:21 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.info" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:21 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.info is being set with open permissions: ugo+rw Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:21 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.info Nov 03 13:15:21 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:21 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 Nov 03 13:15:21 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:21 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.info" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:21 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:21 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40 Nov 03 13:15:21 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6fab3161-8410-48c3-af60-fd69be44796e tempest-ProjectMemberTests-1686242941 None] Create snapshot completed successfully Nov 03 13:15:21 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-d28e87b5-9e15-4faf-9961-de0879a99cfa-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Lock "cinder-quobyte-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40" released by "delete_volume" :: held 0.699s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-d28e87b5-9e15-4faf-9961-de0879a99cfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-e48be385-49fb-4603-a4b8-1c675b6e7e75" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-e48be385-49fb-4603-a4b8-1c675b6e7e75" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-d28e87b5-9e15-4faf-9961-de0879a99cfa" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-d28e87b5-9e15-4faf-9961-de0879a99cfa" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Deleting offline snapshot d28e87b5-9e15-4faf-9961-de0879a99cfa of volume e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] snapshot_file for this snap is: volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Created reservations ['baaffe47-7072-4016-b523-96f203f3213a', '29be8bf5-6f1d-4248-b6bc-7af838d71f9d', '5653ae1f-8726-4a8b-9377-850cbd5efc0d', '85d1d6de-e95e-467b-ab6d-0c777a68a7a5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7fe7db-ba8c-438a-919a-986ca6aa8ad8]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:21 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:15:21 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:21 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa Nov 03 13:15:21 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:22 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Deleted volume successfully. Nov 03 13:15:22 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e48be385-49fb-4603-a4b8-1c675b6e7e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f68b96e-c7f9-438b-981b-7bd20bd8ed42 tempest-ProjectReaderTests-638102560 None] Lock "cinder-c3f0ab1d-c07a-4bde-acab-1bbedccc0b40-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d56c11-5d1c-47ca-90fb-acd854bd9f67]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:22 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 Nov 03 13:15:22 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:22 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:22 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa Nov 03 13:15:22 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:22 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa" returned: 0 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:22 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa Nov 03 13:15:22 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:23 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75.d28e87b5-9e15-4faf-9961-de0879a99cfa" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-d28e87b5-9e15-4faf-9961-de0879a99cfa" released by "_delete_snapshot" :: held 1.549s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-e48be385-49fb-4603-a4b8-1c675b6e7e75" released by "delete_snapshot" :: held 1.584s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Created reservations ['30a037a1-843d-4cb0-8eb7-6d3337da07f1', '9a46035e-58e6-4140-bd11-8f3ada28e1e3', '5572e12a-8693-4fc4-94aa-19f3ad1683b7', '7b42dd8e-e64b-4152-87e7-bf7b0be19285'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Delete snapshot completed successfully. Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a0a66587-324d-4f40-9ef7-fe5ef463d232 tempest-ProjectMemberTests-1686242941 None] Lock "cinder-d28e87b5-9e15-4faf-9961-de0879a99cfa-delete_snapshot" released by "delete_snapshot" :: held 1.763s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-e48be385-49fb-4603-a4b8-1c675b6e7e75-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-e48be385-49fb-4603-a4b8-1c675b6e7e75-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "cinder-quobyte-e48be385-49fb-4603-a4b8-1c675b6e7e75" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-e48be385-49fb-4603-a4b8-1c675b6e7e75" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f529eb-3d03-4856-ae91-96d10d3f6ca4]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:24 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 Nov 03 13:15:24 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:24 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:24 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75 Nov 03 13:15:24 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:24 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-e48be385-49fb-4603-a4b8-1c675b6e7e75" returned: 0 in 0.246s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-quobyte-e48be385-49fb-4603-a4b8-1c675b6e7e75" released by "delete_volume" :: held 0.684s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Created reservations ['dc357a90-43e4-439b-adda-a62922e31148', '2e34e1b3-cec4-4e60-a72f-4dc75f8598d5', '06919b7b-67ab-48cf-beed-e18abe5c616c', 'daa3f30a-c376-47ac-acc7-3626b02d9c49'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:24 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:15:24 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:24 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.251s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Deleted volume successfully. Nov 03 13:15:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7f99253e-b15c-47dc-8c3c-8f31489bcb8b tempest-ProjectMemberTests-1686242941 None] Lock "cinder-e48be385-49fb-4603-a4b8-1c675b6e7e75-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:15:34 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=43,cinder:SELECT=25,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:44 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:44 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=29,cinder:INSERT=15,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Flow 'volume_create_manager' (faa72cfc-44bc-4135-9052-8adf1b3242b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7512287b-aa7f-4809-8e87-d28c42007e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7512287b-aa7f-4809-8e87-d28c42007e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-534497351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f31b6c4-3c65-4ae8-9e36-8ef808b5920b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beaedc8429b141659f10c900bae6ec74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:51Z,use_quota=True,user_id='60c84f4c655643018ed9c4d3d8e3dc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a86e3f4-253d-477a-aaaf-56a8483927b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a86e3f4-253d-477a-aaaf-56a8483927b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7588b0b2-0dcc-4ca3-9f5a-9c9e2a32fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7588b0b2-0dcc-4ca3-9f5a-9c9e2a32fef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f31b6c4-3c65-4ae8-9e36-8ef808b5920b', 'volume_name': 'volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd76997d-1441-4b35-a68d-6ac31c4159e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd76997d-1441-4b35-a68d-6ac31c4159e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f41411-5f1d-4221-82fb-e3f513048456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Volume 6f31b6c4-3c65-4ae8-9e36-8ef808b5920b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b', 'volume_size': 1} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-534497351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f31b6c4-3c65-4ae8-9e36-8ef808b5920b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beaedc8429b141659f10c900bae6ec74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:51Z,use_quota=True,user_id='60c84f4c655643018ed9c4d3d8e3dc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Creating volume 6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:51 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] casted to osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:51 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b 1073741824 Nov 03 13:15:51 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:51 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b 1073741824" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:51 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b Nov 03 13:15:51 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:52 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" returned: 0 in 0.237s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f41411-5f1d-4221-82fb-e3f513048456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbde8be5-82d9-4157-9592-3952bddb6a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Volume volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b (6f31b6c4-3c65-4ae8-9e36-8ef808b5920b): created successfully Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbde8be5-82d9-4157-9592-3952bddb6a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Flow 'volume_create_manager' (faa72cfc-44bc-4135-9052-8adf1b3242b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8b873363-96c5-4e36-9d79-4bc1de37c9d9 tempest-SnapshotDependencyTests-1319356940 None] Created volume successfully. Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Creating offline snapshot 332b1189-51c6-4a93-8801-bc907445c7d1 of volume 6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d838640a-70bf-455f-8f8e-115ce8e48b5a]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:52 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b Nov 03 13:15:52 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:53 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" returned: 0 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:53 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 1G Nov 03 13:15:53 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:53 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 1G" returned: 0 in 0.379s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:53 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 Nov 03 13:15:53 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:53 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b -F qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:53 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 is being set with open permissions: ugo+rw Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:53 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 Nov 03 13:15:53 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:53 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1" returned: 0 in 0.240s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:54 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.info Nov 03 13:15:54 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:54 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.info" returned: 0 in 0.241s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:54 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.info is being set with open permissions: ugo+rw Nov 03 13:15:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:54 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.info Nov 03 13:15:54 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:54 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.info" returned: 0 in 0.231s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ffa5271e-62fe-49e3-9eb7-c92a5f64d092 tempest-SnapshotDependencyTests-1319356940 None] Create snapshot completed successfully Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Flow 'volume_create_manager' (e605f95a-a1ac-477e-9ef5-2ee23cd9acce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8595d968-54d3-4935-83e7-4092eef9c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8595d968-54d3-4935-83e7-4092eef9c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T12:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1645e3ea-0547-4726-98b7-3717db29e812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beaedc8429b141659f10c900bae6ec74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T12:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=332b1189-51c6-4a93-8801-bc907445c7d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T12:15:55Z,use_quota=True,user_id='60c84f4c655643018ed9c4d3d8e3dc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3d953f-022f-4dff-a185-6d6d1a235da9),volume_type_id=6d3d953f-022f-4dff-a185-6d6d1a235da9)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2a71b8-98b1-48d0-b4ae-e2f53adc7d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2a71b8-98b1-48d0-b4ae-e2f53adc7d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3fa638-fa8b-4ccd-ad1c-4e5ebc933d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3fa638-fa8b-4ccd-ad1c-4e5ebc933d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1645e3ea-0547-4726-98b7-3717db29e812', 'volume_name': 'volume-1645e3ea-0547-4726-98b7-3717db29e812', 'volume_size': 1, 'snapshot_id': '332b1189-51c6-4a93-8801-bc907445c7d1'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aac161f-b41e-4c41-ad75-32aa964400b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aac161f-b41e-4c41-ad75-32aa964400b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1d5923-2e08-4c20-a96a-72222fa5dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:15:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Volume 1645e3ea-0547-4726-98b7-3717db29e812: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1645e3ea-0547-4726-98b7-3717db29e812', 'volume_size': 1, 'snapshot_id': '332b1189-51c6-4a93-8801-bc907445c7d1'} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-quobyte-332b1189-51c6-4a93-8801-bc907445c7d1-1645e3ea-0547-4726-98b7-3717db29e812" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-332b1189-51c6-4a93-8801-bc907445c7d1-1645e3ea-0547-4726-98b7-3717db29e812" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Creating volume 1645e3ea-0547-4726-98b7-3717db29e812 from snapshot 332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-quobyte-1645e3ea-0547-4726-98b7-3717db29e812" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-1645e3ea-0547-4726-98b7-3717db29e812" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] snapshot: 332b1189-51c6-4a93-8801-bc907445c7d1, volume: 1645e3ea-0547-4726-98b7-3717db29e812, {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8eb96-b09c-4fc8-a0bc-5708e2f0c1a5]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:55 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 Nov 03 13:15:55 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:55 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1" returned: 0 in 0.341s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c440d96-9c2a-4d21-b8e9-c26f1b5ba3cd]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:15:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:55 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b Nov 03 13:15:55 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:56 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 13:15:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 13:15:56 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Path /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 13:15:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:56 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 Nov 03 13:15:56 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:58 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:15:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:15:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:15:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:15:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:15:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:15:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:15:58 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:15:58 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:15:59 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 03 13:15:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:15:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:15:59 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 13:15:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 13:15:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-59db35ab-2137-406d-9ae1-0c8a8925391e None None] thread info: [<_MainThread(MainThread, started 130424443555968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 13:16:01 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812" returned: 0 in 5.726s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:01 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 13:16:01 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Converted 1024.00 MB image at 178.80 MB/s Nov 03 13:16:01 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 is being set with open permissions: ugo+rw Nov 03 13:16:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:01 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 Nov 03 13:16:01 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:02 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812" returned: 0 in 0.234s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-1645e3ea-0547-4726-98b7-3717db29e812" released by "_copy_volume_from_snapshot" :: held 6.714s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-332b1189-51c6-4a93-8801-bc907445c7d1-1645e3ea-0547-4726-98b7-3717db29e812" released by "_create_volume_from_snapshot" :: held 6.770s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.785s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1d5923-2e08-4c20-a96a-72222fa5dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1645e3ea-0547-4726-98b7-3717db29e812', 'volume_size': 1, 'snapshot_id': '332b1189-51c6-4a93-8801-bc907445c7d1'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f6d7ac-6ff1-43ae-bba8-e2ee8d820a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 13:16:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Volume volume-1645e3ea-0547-4726-98b7-3717db29e812 (1645e3ea-0547-4726-98b7-3717db29e812): created successfully Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f6d7ac-6ff1-43ae-bba8-e2ee8d820a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Flow 'volume_create_manager' (e605f95a-a1ac-477e-9ef5-2ee23cd9acce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 13:16:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-371d010e-6650-4a8d-906d-a771f5abca08 tempest-SnapshotDependencyTests-1319356940 None] Created volume successfully. Nov 03 13:16:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-332b1189-51c6-4a93-8801-bc907445c7d1-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-332b1189-51c6-4a93-8801-bc907445c7d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-quobyte-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-quobyte-332b1189-51c6-4a93-8801-bc907445c7d1" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-332b1189-51c6-4a93-8801-bc907445c7d1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Deleting offline snapshot 332b1189-51c6-4a93-8801-bc907445c7d1 of volume 6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] snapshot_file for this snap is: volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c72e0-1cf2-4eec-b03a-728ffbc8cc04]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:03 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 Nov 03 13:16:03 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:03 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b5db64-e221-4736-9946-1d25dfa71931]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:03 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b Nov 03 13:16:03 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:03 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" returned: 0 in 0.535s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:04 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 Nov 03 13:16:04 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:04 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:04 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1 Nov 03 13:16:04 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:04 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b.332b1189-51c6-4a93-8801-bc907445c7d1" returned: 0 in 0.230s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-332b1189-51c6-4a93-8801-bc907445c7d1" released by "_delete_snapshot" :: held 1.534s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" released by "delete_snapshot" :: held 1.553s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:04 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Created reservations ['4d71ce2f-ae6f-43db-b799-f38b6e6eb22a', '43715a62-89d5-4100-87cf-4869826d1be2', 'bd8e16c2-6a10-40d1-844c-fbae5493be09', '1b377aaa-7938-476e-92d5-b4b6a4c447f6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Delete snapshot completed successfully. Nov 03 13:16:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9752cb4d-2d6a-454b-aca0-06f662fb7933 tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-332b1189-51c6-4a93-8801-bc907445c7d1-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-quobyte-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4751a072-1bb9-4ed8-bb55-a01a7da8146c]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:05 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b Nov 03 13:16:05 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:05 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:05 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b Nov 03 13:16:05 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:05 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" returned: 0 in 0.236s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b" released by "delete_volume" :: held 0.639s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Created reservations ['d970908f-eeab-496f-8230-29e7b7e69c7f', '186c1b65-a105-4cf2-84f4-2c9dd9e21d3c', '8ce5e758-d0c2-4e8c-8bd8-8e2f1f9581e2', 'd51393d8-674c-4b75-92e7-42b4b706b3a1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:05 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:16:05 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:06 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.231s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Deleted volume successfully. Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a00dbfa9-3eaf-4d7c-8bb1-e95b73e3806a tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-6f31b6c4-3c65-4ae8-9e36-8ef808b5920b-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-1645e3ea-0547-4726-98b7-3717db29e812-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-1645e3ea-0547-4726-98b7-3717db29e812-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "cinder-quobyte-1645e3ea-0547-4726-98b7-3717db29e812" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-1645e3ea-0547-4726-98b7-3717db29e812" acquired by "delete_volume" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d21d7-e591-44af-8748-488df92c4b32]: (4, 'qcow2') {{(pid=87896) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:06 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 Nov 03 13:16:06 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:06 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:06 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812 Nov 03 13:16:06 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:06 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43/volume-1645e3ea-0547-4726-98b7-3717db29e812" returned: 0 in 0.234s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-quobyte-1645e3ea-0547-4726-98b7-3717db29e812" released by "delete_volume" :: held 0.609s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Created reservations ['bb953190-e909-4984-9e30-3fbbe356eeb4', 'b22b1958-1f72-47e7-8d65-76cd775fbf8b', 'ed7cc56d-df40-4307-a492-8a3d294892a6', 'f79cd50c-68df-440c-9123-d30af4ca5f59'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ff2d635-b77d-4a90-a64b-ca2babbece25'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 13:16:07 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43 Nov 03 13:16:07 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 13:16:07 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecf53c8a65efec593926e66b8e0bdf43" returned: 0 in 0.228s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 13:16:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Deleted volume successfully. Nov 03 13:16:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1c6198d-2dca-4b27-883a-7d41d1f5d15f tempest-SnapshotDependencyTests-1319356940 None] Lock "cinder-1645e3ea-0547-4726-98b7-3717db29e812-delete_volume" released by "delete_volume" :: held 1.013s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 13:16:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=23,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 13:16:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}